Data Engineer - RDBMS/Hadoop/Big Data (4-7 yrs) Gurgaon/Gurugram (Systems/Product Software)
Task Staffing
Gurugram
2d ago
source : Highorbit Careers Pvt. Ltd

Job Description :

  • You will work in multi-disciplinary environments harnessing data to provide real-world impact for organisations globally.
  • You will influence many of the recommendations our clients need to positively change their businesses and enhance performance.
  • Key responsibilities include :

  • Work with our clients to model their data landscape, obtain data extracts and define secure data exchange approaches
  • Acquire, ingest, and process data from multiple sources and systems into Big Data platforms
  • Understanding, assessing and mapping the data landscape.
  • Maintaining our Information Security standards on the engagement.
  • Collaborate with our data scientists to map data fields to hypotheses and curate, wrangle, and prepare data for use in their advanced analytical models.
  • Defining the technology stack to be provisioned by our infrastructure team.
  • Building modular pipeline to construct features and modelling tables.
  • Use new and creative techniques to deliver impact for our clients as well as internal R&D projects.
  • What you'll learn :

  • How successful projections on real world problems across a variety of industries are completed through referencing past deliveries of end to end pipelines.
  • Build products alongside the Core engineering team and evolve the engineering process to scale with data, handling complex problems and advanced client situations.
  • Be focused on the wrangling, clean-up and transformation of data by working alongside the Data Science team which focuses on modelling the data.
  • Using new technologies and problem-solving skills in a multicultural and creative environment.
  • You will work on the frameworks and libraries that our teams of Data Scientists and Data Engineers use to progress from data to impact.
  • You will guide global companies through data science solutions to transform their businesses and enhance performance across industries including healthcare, automotive, energy and elite sport.

  • Real-World Impact - No project is ever the same; we work across multiple sectors, providing unique learning and development opportunities internationally.
  • Fusing Tech & Leadership - We work with the latest technologies and methodologies and offer first class learning programs at all levels.
  • Multidisciplinary Teamwork - Our teams include data scientists, engineers, project managers, UX and visual designers who work collaboratively to enhance performance.
  • Innovative Work Culture - Creativity, insight and passion come from being balanced. We cultivate a modern work environment through an emphasis on wellness, insightful talks and training sessions.
  • Striving for Diversity - With colleagues from over 40 nationalities, we recognise the benefits of working with people from all walks of life.
  • Our projects range from helping pharmaceutical companies bring lifesaving drugs to market quicker to optimising a Formula1 car's performance.
  • With us you have the best of both worlds; all the benefits of being part of one of the leading management consultancies globally and the autonomy to thrive in a fast growth tech culture :

  • Healthcare Efficiency - We helped a healthcare provider improve their clinical trial practices by identifying congestion in diagnostic testing as a key indicator of admissions breaches.
  • Environmental Impact - We designed and built the first data-driven application for a state of the art centre of excellence in urban innovation by collecting real-
  • time data from environmental sensors across London and deploying proprietary analytics to find unexpected patterns in air pollution.

  • Product Development - We worked with the CEO of an elite automotive organisation to reduce the 18-month car development timeframe by improving processes, designs and team structures.
  • Qualifications :

  • Bachelor's degree in computer science or related field; Master's degree is a plus
  • 4+ years of relevant work experience
  • Meaningful experience with at least two of the following technologies : Python, Scala, SQL, Java
  • Commercial client-facing project experience is helpful, including working in close-knit teams
  • Ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets
  • Meaningful experience in multiple database technologies such as Distributed Processing (Spark, Hadoop, EMR), traditional RDBMS (MS SQL Server, Oracle, MySQL, PostgreSQL), MPP (AWS Redshift, Teradata), NoSQL (MongoDB, DynamoDB, Cassandra, Neo4J, Titan)
  • Confirmed ability in clearly communicating complex solutions
  • Deep understanding of Information Security principles to ensure compliant handling and management of client data
  • Experience and interest in Cloud platforms such as : AWS, Azure, Goole Platform or Databricks
  • Confirmed experience in traditional data warehousing / ETL tools (Informatica, Talend, Pentaho, DataStage)
  • Extraordinary attention to detail
  • Apply
    Add to favorites
    Remove from favorites
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form