Principal Data Engineer
IHS Markit
Bangalore, Karnataka, India
12h ago

Department overview :

IHS Markit electronic parts management solutions enable our customers to master challenges such as innovation imperatives, greater regulations, manufacturer consolidations, counterfeit risk and end of life concerns.

With tools to access component pricing, availability, compliance, counterfeit risk, and reusability information, including the ability to integrate information into their systems, our customers can cultivate and maintain a healthy parts supply chain.

Position summary :

Are you a data engineer with a solid data modeling, NoSQL, big-data and relational expertise and background? Are you someone who architectures, develops, builds and maintains large-scale data and processing systems.

We are looking for a principal data engineer to drive and advance our data and ELT practices and data pipelines. Your objectives will be to team with our software architects to drive scalability, improve data quality and create efficiencies in our data lifecycle.

Engineering and Product Design, as an organization, operates at cutting edge of cloud-based software development, and we are looking for a dynamic, inspired, and collaborative principal data engineer to match the agility and innovation of our software engineers.

This means you have wide expertise and professional experience in numerous cloud-native and open-source frameworks and applications.

What You'll Do :

  • Passionate about moving large and complex unstructured and structured data sets thru simple and elegant data pipelines to create value, quality and time to market.
  • Strong communication and interpersonal skills. You must be able to work across functions and effectively present, recommend, and communicate a position by demonstrating its value and trade-offs.
  • Ability to ramp quickly with the terminology, processes, domain, and business goals.
  • Evaluate and implement new and upcoming database technologies.
  • Capable and willing to do the hands-on heavy lifting of data organization, clean up, and cataloging of the data needed to solve problems.
  • You are a hands-on data expert. Strong database and SQL skills required.
  • What You Need to Get the Job Done :

  • Bachelor’s degree in a computer, engineering or a quantitative discipline
  • 8-10 years of relevant work experience in the large-scale database space.
  • Extensive experience with designing, building and maintaining event-based architectures utilizing loosely coupled software components and services.
  • Proven fluency in the use of Python and / or Scala. Operational expertise in the use of Spark and other data engineering frameworks.
  • Expertise with various SQL and NoSQL systems such as Cassandra, CosmosDB, REDIS, Oracle, SQL Server, MongoDB, PostgreSQL.
  • Capable of creating effective NoSQL and tidy database schema designs.

  • Experience with CI / CD related to automated database deployment and loading practices.
  • Experience monitoring database infrastructure for performance enhancements, tracing sessions and troubleshooting database issues.
  • Experience with Cloud based computing and solutions.
  • Demonstrated leadership and self-direction. Demonstrated willingness to both teach others and learn new techniques.
  • What You'll Love About Us Do ask us about these!

  • Total Rewards. Monetary, beneficial and developmental rewards!
  • Work Life Balance. You can't do a good job if your job is all you do!
  • Prepare for the Future. Academy we are all learners; we are all teachers!
  • Employee Assistance Program. Confidential and Professional Counselling and Consulting.
  • Diversity & Inclusion. HeForShe!
  • Internal Mobility. Grow with us!
  • Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form