Senior Big Data Engineer - Redshift/Hadoop/MapReduce (5-8 yrs) Noida/Pune (DevOps)
Anantha
Pune
4h ago
source : hirist.com

Responsibilities :

  • Designing, Creating, & Maintaining data management & processing systems
  • Building highly scalable, robust & fault-tolerant systems
  • Taking care of the complete ETL process
  • Discovering data acquisitions opportunities
  • Improving Data Quality, Reliability &Efficiency of the system
  • Creating solutions by integrating variety of programming languages & tools
  • Introducing new data management tools & technologies into the existing system to make it more efficient
  • Deploying Disaster Recovery Techniques
  • Introducing new data management tools & technologies into the existing system to make it more efficient.
  • Requirements :

  • 5to 8 years of recent experience in Big Data Engineering
  • Knowledge of Hadoop ecosystem and different frameworks inside it
  • Should have Experience in :

  • Data Processing : Hadoop, Hive, Spark, MapReduce, Python, Pyspark
  • Data Ingestion : Sqoop, Flume
  • Experience on Kafka, Oozie, PIG
  • NOSQL Database : Hbase, Mongo DB, Cassandra etc. (At least one)
  • AWS Cloud (Glue, Athena, Redshift, Talend OR Altery)
  • Real-time processing Framework (Apache Spark)
  • SQL-based technologies (e.g. MySQL etc.)
  • Knowledge of machine learning tool such as SparkML / Mahout would be plus
  • Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources
  • Problem solving mindset working in agile environment
  • Experience in support and troubleshooting
  • BE, BTech or equivalent
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form