Development Engineer 2
Chennai, Tamil Na, IN
6d ago

Business Unit : Summary :

Summary :

ETL Developer - responsible for developing highly-reliable ETL solutions & enhancing existing ETL solutions that aid in a variety of Backoffice processes across systems requiring synchronization / reconciliation of Data in a diverse Database ecosystem.

Monitors emerging technologies / technology practices for potential use within the Company. Develops updated infrastructure in support of one or more business processes.

Helps to ensure a balance between tactical and strategic technology solutions. Mentors, reviews codes and verifies that the object oriented design best practices and that coding and architectural guidelines are adhered to.

Identifies and drives issues through closure. Integrates knowledge of business and functional priorities. Acts as a key contributor in a complex and crucial environment.

The successful candidate will be responsible for quality software development following agile principles and help install and operate systems in a continuous delivery model.

The selected person should be a team worker who has experience working along with a geographically distributed team. Strong analytical, programing and troubleshooting skills to understand, analyze business requirements and build quality deliverables or operate and sustain complex systems.

Core Responsibilities :

  • ETL Development to perform Data Aggregation, Data Cleansing & Deriving insights
  • Support and enhance the data pipeline framework, enable its deployment and automation.
  • Design, develop and support scalable ETL components to aggregate and move data from a variety of structured and unstructured data sources to the data warehouse / big data platform
  • Work in a geo-distributed, multi-functional team comprising of DBAs, Backend Developers, Product teams, Scrum Masters to achieve requisite functionality in an Agile methodology driven Project
  • Design, develop and support scalable ETL components to aggregate and move data from a variety of structured and unstructured data sources to the data warehouse / big data platform
  • Support data pipelines and automate, control and monitor data movements and deploy appropriate control mechanisms for alerts, traceability, data validation, archival etc.
  • Practice test-driven development in an Agile / Scrum environment
  • Develop detailed logical and physical design solutions through understanding business and technology strategies and roadmaps in line with company policies and architectural standards
  • Consistent exercise of independent judgment and discretion in matters of significance.
  • Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary.
  • Other duties and responsibilities as assigned.
  • Skills and Experience :

  • 5+ years overall experience in data integration from multiple data sources (RDBMS, NoSQL, Bigdata)
  • 5+ years of experience in dealing with high volume data, and complex data sets
  • 5+ years of experience in Data Warehousing, and ETL Development, Data transformations using Pentaho, Hive, or Spark
  • 5+ years Expert in Data Warehousing methodologies(Kimball Dimensional Modeling, Inmon EDW concepts)
  • 5+ Years of development experience in Hadoop, Hive, Spark (Scala or Python)
  • 5+ years of overall experience in integrating data in multiple platforms (Oracle, Hadoop etc)
  • 2+ years in data streaming and realtime data processing( Spark, Kafka )and interfacing with bigdata or rdbms (Hadoop, Cassandra, oracle) must have
  • Experience with AWS bigdata tools like eMR, Kinesis and other data tools a plus
  • Expert in reading and interpreting data models and ER diagrams and translating them into ELT or ETL code
  • 5+ years of experience in developing unix based shell scripts using shell commands, utilities and tools
  • 5+ years of experience in troubleshooting technical processes and jobs or workflows
  • Experience in dealing with Data Quality issues
  • Excellent at data analysis and problem analysis
  • Experience in Quality measures to ensure expected process outcomes
  • Experience in establishing and maintaining job dependencies in an automated fashion
  • 5+ years of experience in working with large US clients (Telecom MSO / Telephony - a plus)
  • Experience in job automation using enterprise scheduler ( Rundeck etc - a plus)
  • Experience in Release management and deployment process (SOPs and release notes)
  • Experience in data profiling and unit testing
  • Experience in code review and defect tracking
  • Experience in code versioning systems (GIT a must)
  • Knowledge of ETL process and component architecture (Pentaho a plus)
  • Compliance

    Disclaimer The above information has been designed to indicate the general nature and level of work performed by employees in this role.

    It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

    Comcast is an EEO / AA / Drug Free Workplace. Comcast is an equal employment employer.

    Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form