Job Purpose and Impact
The Data Engineer will treat data as an asset to design, build and execute high performance and data centric solutions by using the comprehensive big data capabilities for the company's data platform environment.
In this role, you will build and optimize data products to bring data and analytics products and solutions to businesses.
Collaborate with businesses and other stakeholders to participate in product or solution designs.
Develop robust, scalable and sustainable data products or solutions utilizing cloud based technologies.
Provide moderately complex technical support through all phases of product or solution life cycle.
Perform data analysis, handle data modeling and configure and develop data pipelines to move and optimize data assets.
Build moderately complex prototypes to test new concepts and provide ideas on reusable frameworks, components and data products or solutions and help promote adoption of new technologies.
Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
Other duties as assigned
Bachelor's degree in a related field or equivalent experience
Minimum of four years of related work experience
Experience with Big Data technologies ( Hadoop, Spark, impala, Hive etc.)
Strong knowledge and hands on work experience of writing the programs in scala / python for Spark framework
Proficient in SQL and advanced SQL and able to write the complex SQL queries
Work with the product teams and build robust and scalable data integration (ETL) pipelines using Spark and Scala / Python / SQL
Experience in visualization tools, such as Tableau and PowerBI, and cloud data warehouses such as SnowFlake
Experience in financial markets, stock trading, derivatives, futures, and options.