Data Engineer
Cargill
Bengaluru, India
4d ago

Job Purpose and Impact

The Data Engineer will treat data as an asset to design, build and execute high performance and data centric solutions by using the comprehensive big data capabilities for the company's data platform environment.

In this role, you will build and optimize data products to bring data and analytics products and solutions to businesses.

Key Accountabilities

  • Collaborate with businesses and other stakeholders to participate in product or solution designs.
  • Develop robust, scalable and sustainable data products or solutions utilizing cloud based technologies.
  • Provide moderately complex technical support through all phases of product or solution life cycle.
  • Perform data analysis, handle data modeling and configure and develop data pipelines to move and optimize data assets.
  • Build moderately complex prototypes to test new concepts and provide ideas on reusable frameworks, components and data products or solutions and help promote adoption of new technologies.
  • Independently solve moderately complex issues with minimal supervision, while escalating more complex issues to appropriate staff.
  • Other duties as assigned
  • Qualifications

    Minimum Qualifications

  • Bachelor's degree in a related field or equivalent experience
  • Minimum of four years of related work experience
  • Experience with Big Data technologies ( Hadoop, Spark, impala, Hive etc.)
  • Strong knowledge and hands on work experience of writing the programs in scala / python for Spark framework
  • Proficient in SQL and advanced SQL and able to write the complex SQL queries
  • Work with the product teams and build robust and scalable data integration (ETL) pipelines using Spark and Scala / Python / SQL
  • Preferred Qualifications

  • Experience in visualization tools, such as Tableau and PowerBI, and cloud data warehouses such as SnowFlake
  • Experience in financial markets, stock trading, derivatives, futures, and options.
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form