Position Summary :
Senior Data Engineer will be an integral part of the data platform initiative that's going to serve across the organization, and caters to various business data needs of Clients.
He / She will have ample exposure into the new cutting edge technologies to build out our modern Data Platform. Collaboration with multiple teams like Business Users, Tech Partners, UX Team, Ops team etc are key to this role.
His / her experience and expertise, along with willingness to learn and collaborate with teams make him / her the right candidate
ROLES AND RESPONSIBILITIES :
8-10 years of experience in data engineering, dealing with massive amounts of data and pipelines built to process them in Data Lakes, Data Warehouses etc.
Min 4 years experience in Python Programming, specific to data pipeline developemt
Experience and Expertise in Using tools like Apache NiFi, Apache Airflow, Traditional ETL tools etc.
Experience with Apache Spark, and similar processing platforms
Very good experience in Database programming, and helping with ETL / ELTs.
Willingness to learn and pick up on new open source technologies
Additional Preferred Experience (Good to have) :
Working knowledge in NoSQL databases like Document Type CouchDB, Graph Type NEO4J etc.
Semantic Knowledge Graph exposure
Exposure in NLP and other data extraction approaches
Good understanding of Machine Learning, Deep learning concepts and models