Data Engineer - GCP
Lister Technologies
Chennai, India
1d ago

Essential Skill :

  • Strong Python development experience with Data integration experience. Should have worked on handling huge data.
  • Strong communication skills, experience in Agile methodologies, ETL / ELT skills, Data movement skills, Data processing skills.
  • Role Description :

  • Strong expertise to build Data Services in Google Cloud Platform
  • Able to build end-applications using a correct choice of Big Data GCP Components like GCS, DataFlow, Dataproc, BigQuery, BigTable, Pub / Sub and Open Source components like MongoDB, Cassandra, Kafka, etc.
  • Implement and support efficient reliable data pipelines to move data from a wide variety of data sources to data marts / data lake
  • Working experience in one of RDBMS data stores like Oracle, MySQL, PostgreSQL etc. and one of NoSQL data stores like HBase, Mongo, Cassandra etc.
  • Implement data aggregation, cleansing and transformation layers
  • Ability to build Data Ingestion frameworks taking into account access patterns, scalability, response time and availability.
  • Experience in Big data integration and stream processing technologies using Apache Kafka, Kafka Connect (Confluent), Apache NiFi, Flume, Sqoop, Spark, Hive
  • Experience working on writing Pub - Sub APIs, developing Kafka Streams, Kafka connect, KSQL
  • Developing new processors within Apache NiFi and establishing new data flows / troubleshooting existing data flows to the various hardware instances associated with the different data platforms.
  • Experience with serialization such as JSON and / or BSON.
  • Employment Type : Permanent

    Apply
    Add to favorites
    Remove from favorites
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form