We are looking for a Data bricks Module Lead with good knowledge & understanding of Datalakes, Data bricks, Hadoop, Hive, T-SQL, SQL server, Synapse DB and Data warehouse.
Apply now to work with a world-class team in a flexible work environment!
Experience : 5 8 Years
Job Location : Chennai / Bangalore / Kochi
Notice Period : Immediate 30 Days
Requirements :
Expertise in Datalakes, Data bricks, Hadoop, Hive, T-SQL, SQL server, Synapse DB, Data warehouse
Hands-on experience in ETL, ELT, handling large volume of data and files.
Working knowledge in JSON, Parquet, CSV, EXCEL, Structured, Unstructured data and other data sets
Exposure to any Source Control Management, like TFS / GIT / SVN
Should be proficient in DWH, MPP systems, OLTP, and OLAP systems
Must have real-time experience in DWH, AWS Glue, Data migration and SSIS lift and shift
Responsibilities :
Create Data lakes from scratch, configure existing systems and provide user support
Understand different datasets and Storage elements to bring data
Have good knowledge and work experience in Databricks
Have good knowledge in Python and Spark SQL
Implement Data security at DB and data movement layers
Should have experience in ADF / AWS Glue / Outpost / CI / CD pipelines
Should have good experience in Data lake, HDFS, Hive, Hadoop
Work with internal teams to design, develop and maintain software
Other Skills :
Understanding of non-functional requirements
A good team player and excellent communicator