Lead Data Engineer
Chennai, India
2d ago
source : Cutshort
  • Key skill set : Apache NiFi, Kafka Connect (Confluent), Sqoop, Kylo, Spark, Druid, Presto, RESTful services, Lambda / Kappa architecturesResponsibilities : - Build a scalable, reliable, operable and performant big data platform for both streaming and batch analytics- Design and implement data aggregation, cleansing and transformation layersSkills : - Around 4+ years of hands-on experience designing and operating large data platforms- Experience in Big data Ingestion, Transformation and stream / batch processing technologies using Apache NiFi, Apache Kafka, Kafka Connect (Confluent), Sqoop, Spark, Storm, Hive etc;
  • Experience in designing and building streaming data platforms in Lambda, Kappa architectures - Should have working experience in one of NoSQL, OLAP data stores like Druid, Cassandra, Elasticsearch, Pinot etc;
  • Experience in one of data warehousing tools like RedShift, BigQuery, Azure SQL Data Warehouse - Exposure to other Data Ingestion, Data Lake and querying frameworks like Marmaray, Kylo, Drill, Presto- Experience in designing and consuming microservices- Exposure to security and governance tools like Apache Ranger, Apache Atlas - Any contributions to open source projects a plus- Experience in performance benchmarks will be a plus Skills : - Apache Spark, Druid Database, Big Data, Apache Kafka, Apache Sqoop, RESTful APIs, Elasticsearch, Apache Ranger, Apache Atlas and kappa
  • Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form