Reports to Development Manager SSE- strong Exp in Java with some exposure in Big Data (should have big data conceptual knowledge) Exp- 3-6 years TL- strong Exp in Java strong Exp in Big Data some mentoring Exp Exp- 6-10 years Job Description As a Big data engineer you will be responsible for Design and development of low-latency, highly-performance data analytics applications Collaborate with peer engineers and architects on various technical projects to maintain and enhance data analytics solutions Participate in code and design review of different application modules Write and run comprehensive integration tests to deliver high-quality products Capacity planning and specification of resource requirements for different deployment scenarios Trouble-shoot and provide fix for any production bug in timely manner Gather feedback from stakeholders for improvement in code-stack and feature-sets Assist documentation team in providing good customer documentation, support and deployment guides Adopt agile practice to track and update status of assigned tasks / stories Educational Qualification BE.
B.Tech., M.E. / M. Tech. or M. Sc. in Computer Science or any related field. Required Candidate profile Skill Set Hands on programming experience in Java is must.
Candidate should have practical knowledge of object-oriented programming concepts, data structures, algorithms, multithreading, collections, concepts of garbage collection.
Conceptual understanding of Big Data concepts, relevant experience of minimum 2 years on Big Data Technologies- HDFS, s3, Spark, Spark Streaming, Kafka, Hive, Cassandra, etc is required.
Expertise in performance tuning and resource optimization techniques of spark Broadcasting, Salting, Bucketing, Partitioning, Caching, Checkpointing.
Hands-on experience with spark streaming, Data Frames and SQL API. Well familiar with data-warehousing concepts, data modelling, metadata management, data lineage etc is desirable.
Some exposure to UI technologies is good to have. Well familiar with distributed systems, scalable architecture and parallel computing.
Exposure to relational database like Oracle & MySQL is must. Good understanding of source code maintenance tools and CI / CD (Continuous integration / continuous Development) pipelines.
Work Experience 3 -10 years of experience in Data platform and analytics application development Location Bangalore Key Skills s3 Java algorithms data modelling Cassandra Big Data HDFS Kafka Data Frames Bucketing Spark Streaming SQL Hive Partitioning Caching collections Broadcasting data structures multithreading Spark Checkpointing. Salting