Sr. Big Data Engineer - Cloudera/ Hortonworks
innData Analytics Private Limited
Visakhapatnam, INDIA
1d ago
source : TimesJobs

Location Visakhapatnam Experience 5-6 years Notice Period 30 days Roles and Responsibilities Design & implement new components and various emerging technologies in Hadoop Eco System, and successful execution of various projects.

Integrate external data sources and create data lake / data mart. Integrate machine learning models on real-time input data stream.

Collaborate with various cross-functional teams infrastructure, network, database. Work with various teams to set up new Hadoop users, security and platform governance which should be pci-dss complaint.

Create and executive capacity planning strategy process for the Hadoop platform. Monitor job performances, file system / disk-space management, cluster & database connectivity, log files, management of backup / security and troubleshooting various user issues.

Design, implement, test and document performance benchmarking strategy for the platform as well for each use cases. Drive customer communication during critical events and participate / lead various operational improvement initiatives.

Responsible for setup, administration, and monitoring, tuning, optimizing, governing Large Scale Hadoop Cluster and Hadoop components On-Premise / Cloud to meet high availability / uptime requirements.

  • 2-4 years relevant experience in BIG DATA. Exposure to Cloudera / Hortonworks production implementations. Knowledge of Linux and shell scripting is a must.
  • Sound knowledge on Python or Scala. Sound knowledge on Spark, HDFS / HIVE / HBASE Thorough understanding of Hadoop, Spark, and ecosystem components.

    Must be proficient with data ingestion tools like sqoop, flume, talend, and Kafka. Candidates having knowledge on Machine Learning using Spark will be given preference.

    Knowledge of Spark & Hadoop is a must. Knowledge of AWS and Google Cloud Platform and their various components is preferable.

    Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form