Azure Data Engineer
Mercedes-Benz Research and Development India Private Limited
Bengaluru, IN
2d ago

Azure Data Engineer

Keywords : Microsoft Azure, Azure Data Factory, ADLS, Log Analytics, ELT, Big Data, Azure DevOps, Azure Boards, VSTS Git

Hey, do you want to change the world? Build #TheNextBigThing? Which means implementing ideas that are said to be unachievable?

Like it was stated at first about smart chatbots or artificial intelligence. At MBRDI you are dealing with questions, for which there are no answers. Not yet.

About Us

The Corporate Center of Excellence (CoE) for AI, Advanced Analytics and Big Data is working on #TheNextBigThing. Besides conducting cool use cases in the field of Data Analytics and AI, we are inventing, building and running eXtollo a data analytics cloud platform based on Microsoft Azure for Daimler teams around the world.

Our users trust in the cross-divisional platform to create secure and scalable cloud applications based on Machine Learning, Artificial Intelligence & Big Data technologies.

In addition to the provisioning and utilization of the technology we are also responsible for Daimler’s data treasure the eXtollo Data Lake.

Role

We are searching you as a Data Engineer to continuously improve eXtollo within an agile working environment. You are expected to work directly with customers to understand their data demands and build end to end pipelines to get the data as they wish.

Also be able to understand the current codes, pipelines and scripts which are already in production in a short time and support operations / changes.

Experience of data migration into Azure from various cloud and on-prem is a plus. You are expected to have good exposure to structured query language preferably MS Sql Server.

Should be able to do PoC for the new adaptions and work independently with minimal guidance. Data warehouse / data engineering experience is appreciated.

Most importantly the candidate should have real hands-on experience rather bookish / training experience.

Responsibilities

  • Touch base with customers to collect the requirements and analyze them
  • Design and build end-to-end data pipelines to get the data for customers
  • Unit testing of the pipelines and UAT support
  • Deployment and post production support
  • Understand the current codes, pipelines and scripts in production and fix the issues in case of incidents.
  • Adapt changes to the existing scripts, codes and pipelines.
  • Reviewing design, code and other deliverables created by your team to guarantee high-quality results
  • Capable enough to own the PoCs and deliver the results in reasonable time
  • Accommodate and accomplish any ad-hoc assignments
  • Building CI / CD pipelines in Azure DevOps to deliver our services into various data centers worldwide
  • Analyzing and solving incidents in productive environment while avoiding data loss and minimizing service outages
  • Challenging current practices, giving feedback to colleagues and encouraging software development best-practices to build the best solution for our users
  • Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Technology or equivalent work experience
  • 3+ years of full time data engineering experience
  • 3+ years of work experience with Azure and Azure Data Factory, Storage accounts and Notebooks
  • Skilled in ETL / ELT process. Good working knowledge with ETL tools.
  • Must be experienced with Hadoop / Big data eco systems
  • Data migration experience from on premise to cloud
  • Expertise in structured query language and PL / SQL
  • Experienced in Powershell scripting for orchestration
  • Exposure to log analytics and debugging
  • Good knowledge in DevOps, Continuous Deployment and testing techniques
  • Agile development experience
  • Fluent English in spoken and written
  • Preferred Qualifications

  • Microsoft Azure Certifications
  • Working experience with Data Factory, Data Lake Storage, Role Based Access Control and Log Analytics
  • Hands-on experience with Databricks notebooks
  • Working experience in an international team or abroad
  • Azure Data Engineer

    Keywords : Microsoft Azure, Azure Data Factory, ADLS, Log Analytics, ELT, Big Data, Azure DevOps, Azure Boards, VSTS Git

    Hey, do you want to change the world? Build #TheNextBigThing? Which means implementing ideas that are said to be unachievable?

    Like it was stated at first about smart chatbots or artificial intelligence. At MBRDI you are dealing with questions, for which there are no answers. Not yet.

    About Us

    The Corporate Center of Excellence (CoE) for AI, Advanced Analytics and Big Data is working on #TheNextBigThing. Besides conducting cool use cases in the field of Data Analytics and AI, we are inventing, building and running eXtollo a data analytics cloud platform based on Microsoft Azure for Daimler teams around the world.

    Our users trust in the cross-divisional platform to create secure and scalable cloud applications based on Machine Learning, Artificial Intelligence & Big Data technologies.

    In addition to the provisioning and utilization of the technology we are also responsible for Daimler’s data treasure the eXtollo Data Lake.

    Role

    We are searching you as a Data Engineer to continuously improve eXtollo within an agile working environment. You are expected to work directly with customers to understand their data demands and build end to end pipelines to get the data as they wish.

    Also be able to understand the current codes, pipelines and scripts which are already in production in a short time and support operations / changes.

    Experience of data migration into Azure from various cloud and on-prem is a plus. You are expected to have good exposure to structured query language preferably MS Sql Server.

    Should be able to do PoC for the new adaptions and work independently with minimal guidance. Data warehouse / data engineering experience is appreciated.

    Most importantly the candidate should have real hands-on experience rather bookish / training experience.

    Responsibilities

  • Touch base with customers to collect the requirements and analyze them
  • Design and build end-to-end data pipelines to get the data for customers
  • Unit testing of the pipelines and UAT support
  • Deployment and post production support
  • Understand the current codes, pipelines and scripts in production and fix the issues in case of incidents.
  • Adapt changes to the existing scripts, codes and pipelines.
  • Reviewing design, code and other deliverables created by your team to guarantee high-quality results
  • Capable enough to own the PoCs and deliver the results in reasonable time
  • Accommodate and accomplish any ad-hoc assignments
  • Building CI / CD pipelines in Azure DevOps to deliver our services into various data centers worldwide
  • Analyzing and solving incidents in productive environment while avoiding data loss and minimizing service outages
  • Challenging current practices, giving feedback to colleagues and encouraging software development best-practices to build the best solution for our users
  • Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Technology or equivalent work experience
  • 3+ years of full time data engineering experience
  • 3+ years of work experience with Azure and Azure Data Factory, Storage accounts and Notebooks
  • Skilled in ETL / ELT process. Good working knowledge with ETL tools.
  • Must be experienced with Hadoop / Big data eco systems
  • Data migration experience from on premise to cloud
  • Expertise in structured query language and PL / SQL
  • Experienced in Powershell scripting for orchestration
  • Exposure to log analytics and debugging
  • Good knowledge in DevOps, Continuous Deployment and testing techniques
  • Agile development experience
  • Fluent English in spoken and written
  • Preferred Qualifications

  • Microsoft Azure Certifications
  • Working experience with Data Factory, Data Lake Storage, Role Based Access Control and Log Analytics
  • Hands-on experience with Databricks notebooks
  • Working experience in an international team or abroad
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form