Development Manager/Project Lead - Big Data/PySpark/Azure Databricks (9-14 yrs) Hyderabad (DevOps)
Excelra Knowledge Solutions
6d ago
source :

Job Requirements & Responsibilities :

  • Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark, PySpark and Azure Databricks with Notebook.
  • Delivering and presenting proofs of concept of key technology components to project stakeholders.
  • Direct experience of building data pipelines using Azure Data Factory and Apache Spark (with Databricks).
  • Hands-on experience designing and delivering solutions using the Azure Data Analytics platform (Cortana Intelligence Platform) including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
  • Experience with Apache Kafka / Nifi for use with streaming data / event-based data
  • Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala)
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
  • Report this job

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form