Data Engineer - Big Data/Hadoop/Spark (2-5 yrs) Bangalore (Analytics & Data Science)
NovoTree Minds
Bangalore, India
6d ago
source : hirist.com

The responsibilities are detailed as below :

  • Experience in understanding and translating data, analytic requirements and functional needs into technical requirements while working with global customers
  • Build and maintain data pipelines to support large scale data management in alignment with data strategy and data processing standards
  • Experience in Database programming using multiple flavor of SQL
  • Deploy scalable data pipelines for analytical needs
  • Experience in Big Data ecosystem - on-prem (Hortonworks / MapR) or Cloud (Dataproc / EMR / HDInsight)
  • Worked on query languages / tools such as Hadoop, Pig, SQL, Hive, Sqoop and SparkSQL.
  • Experience in any orchestration tool such as Airflow / Oozie for scheduling pipelines
  • Exposure to latest cloud ETL tools such as Glue / ADF / Dataflow
  • Understand and execute IN memory distributed computing frameworks like Spark (and / or DataBricks) and its parameter tuning, writing optimized queries in Spark
  • Hands-on experience in using Spark Streaming, Kafka and Hbase
  • Experience in latest cloud ETL tools such as Glue / ADF / Dataflow
  • Experience in any orchestration tool such as Airflow / Oozie
  • Experience working in an Agile / Scrum development process
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form