Big Data Hadoop Engineer 2
Effectv
Chennai, IN
3d ago

Job Summary

Responsible for assisting in the design of system architectures and solutions to bring to market new innovative products which span web service offerings.

Assists in the planning, designing, integrating, testing, deploying and supporting of products. Helps with testing and operational activities.

Works with moderate guidance in own area of knowledge.

Job Description

Role and Responsibilities :

Must Have

  • Analyzes and determines data integration needs
  • Experience with DevOps tools (GitHub, Jira) and methodologies (Agile, Scrum, Kanban, Test Driven Development)
  • Hands on experience with Hadoop ecosystem tools like Spark, YARN, HDFS, Hive, Sqoop, understanding of systems performance data (collection, monitoring, analysis)
  • Deep knowledge of SQL and data sourcing ETL tools
  • Building integration code or reusable frameworks using Spark with Scala or Python
  • Trouble shooting / Reverse Engineering jobs / workflows is a must
  • Experience in job scheduling tools (UC4, Control M, Autosys etc.)
  • Edits and reviews technical requirements documentation
  • Monitor job performances, file system / disk-space management, cluster and database connectivity, log files, management of backup / security and troubleshooting various user issues
  • Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary
  • Good communication skills and a can-do attitude
  • Nice To have

  • Exposure to data integration and storage in AWS - S3, Lambda, Glue Crawlers, Data Pipelines
  • Exposure to data loads in Databricks
  • Evaluates and plans software designs, test results and technical manuals using Big Data (Hadoop) ecosystem or object storage system
  • Works independently, assumes responsibility for job development and training, researches and resolves questions and problems, requests supervisor input and keeps supervisor informed required
  • Consistent exercise of independent judgment and discretion in matters of significance
  • Other duties and responsibilities as assigned
  • Compliance Disclaimer :

    Comcast NBC Universal is an equal opportunity, Veterans, Disabled and LGBT employer

    Core Responsibilities

  • Develops solutions to a wide range of difficult applications, problems or procedures.
  • Supports Lead Engineer with the architecture, design, development, qualification and deployment of applications consistent with product and technical roadmaps.
  • Works with engineering project management and lead engineer to deliver applications that meet or exceed product requirements, project schedules and reliability.
  • Assists product development and operations teams to define technical requirements to accompany existing products and operation requirements.
  • Designs and develops use cases in support of the technical requirements. Transforms technical requirements into architectures.

  • Determines resources, technology and course of action to achieve results.
  • Provides leadership and consultative direction to the organization, department and group.
  • Consistent exercise of independent judgment and discretion in matters of significance.
  • Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) and overtime as necessary.
  • Other duties and responsibilities as assigned.
  • Employees at all levels are expected to :

  • Understand our Operating Principles; make them the guidelines for how you do your job.
  • Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services.
  • Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences.
  • Win as a team - make big things happen by working together and being open to new ideas.
  • Be an active part of the Net Promoter System - a way of working that brings more employee and customer feedback into the company - by joining huddles, making call backs and helping us elevate opportunities to do better for our customers.
  • Drive results and growth.
  • Respect and promote inclusion & diversity.
  • Do what's right for each other, our customers, investors and our communities.
  • Disclaimer :

  • This information has been designed to indicate the general nature and level of work performed by employees in this role.
  • It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

    Comcast is an EOE / Veterans / Disabled / LGBT employer.

    Bachelor's Degree

    Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form