Data Engineering Manager- Azure Lead, DWH/ETL, ADF - Multiple Locations
UnitedHealth Group
Noida, Uttar Pradesh, IN
3d ago

Primary Responsibilities :

  • Migrated a large onprim ETL solution to cloud (azure) and streamline process to smooth execution of weekly / monthly data refreshes
  • Manage orchestration and scheduling of end to end data pipeline using tool like Apache airflow, ADF scheduling, logic apps
  • Review the solutions from team to determine the optimal usage of Airflow SQL, ADF and Databricks and ensure reusability
  • Designing solutions that make use of Azure‚Äôs Run time execution using containers, function app and leverage stateless and serverless designs
  • Effective collaboration with Architecture team in designing solutions and with product owners with validating the implementations
  • Implementing best practices to enable data quality, monitoring, logging and alerting the failure scenarios and exception handling
  • Forecast the staffing requirements, estimate the new integrations and proactively call out challenges and issues
  • Plan and manage the deliveries of complex integrations without cost escalation and any time delay
  • Mentoring fellow engineers on implementation aspects and grooming up team member for ideas
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and / or re-assignment to different work locations, change in teams and / or work shifts, policies in regards to flexibility of work benefits and / or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment).
  • The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

    Required Qualifications :

  • Any graduate with 15+ years education
  • 5+ years of experience in data engineering and working on large data warehouse MPP database systems like Synapse analytics including design and development of ETL on distributed platforms
  • 3+ years of experience in managing deliveries for a data warehousing application with accountable role
  • 2+ years of experience in Azure cloud eco system particularly on azure resources for data & ETL migration from on perm to cloud
  • 2+ years of experience in Azure database offering like SQL DB, SQL DW, constructing data pipelines using Azure data factory, design and development of analytics using Azure data bricks
  • 2+ years of experience on working with cloud native monitoring and logging tool like Log analytics or having experience on any third-party services is a plus
  • 1+ years of experience in scheduling tools on cloud either using Apache Airflow or logic apps or any native / third party scheduling tool on cloud
  • Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form