Lead Data Engineer - Java/Hadoop/Python (7-12 yrs) Mumbai (Backend Developer)
Adept Global
Mumbai, India
2d ago
source : hirist.com

Experience : 7+ years

Location : Andheri (E) , Mumbai

Designation : Data Engineer

Minimum Qualifications :

1) Previous experience in data engineering

2) Familiar with more modern data engineering pipelines and how they all fit together.

3) Experience with integration of data from multiple data sources

4) Able to articulate needs on both sides easily. Can talk with backend and data science people both with ease Data Engineer will work directly with the backend engineering team.

5) Proficiency with REST APIs, Cassandra, Python, MongoDB, Postgres, and querying.

6) Proficiency with both relational and non-relational databases and how to combine them

7) Proficiency with distributed computing engines, frameworks like Hadoop v2, Spark

8) Experience with building stream-processing systems, (e.g., using solutions such as Spark-Streaming or Storm)

9) Ability to manage Hadoop / Spark cluster or other ingestion tools, with all included services

10) Previous Experience with various messaging systems, such as Kafka or Amazon Kinesis (for example)

11) Coding Experience with any of the programming languages - Python, Java, Scala

12) Excellent communication skills Willingness to document work in a wiki and track work through an issue tracking system

13) 5+ years of data engineering experience

14) BS in Computer Science or a related field and relevant experience

Preferred Qualifications :

1) Previous start-up experience

2) Machine Learning experience or learning different ML techniques (for bigger data sets)

3) Experience with AWS cloud platform and services

4) Ability to solve any ongoing issues with operating the cluster / data pipelines

Software development methodologies skills such as :

a) Experience with a source control system

b) Experience with an issue tracking system

c) Preliminary testing and verification

d) Experience with the design and development life-cycle

e) Knowledge of debugging and problem-solving methodology, particularly as reported against

Production software :

1) Have worked on shipping product

2) Knowledge with Data Structures(e.g., queues, arrays, maps)

3) Additional skills that add value to our company (technical or domain)

4) A passion for our product space and a desire to improve the lives of others

My Email
By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
Application form