Job Description :
Excellent opportunity to work on cutting edge technologies with Broadcom Enterprise Security Division ( Symantec ) with Big data analytics platform applications team.
The team is responsible for data ingestion, ETL, and storage and support Spark / Hive / Kafka-based compute platform for developing data analytics, ML applications and microservices.
Analytics applications development is focussed on security analytics targeting cyber-insurance, cyber risk modeling, threat intelligence, threat detection, and reputation analysis to customers.
Key Responsibilities :
Design and develop robust and scalable analytics processing applications with strong understanding of best practices and frameworks for high volume data processing and analytics
Passionate about research and exploring the use of innovative technologies and techniques and evaluating them for suitability data engineering and analytics and machine learning.
Work with business stakeholders and help define the big data solutions, conceptualize and build prototypes rapidly.
Provide technical leadership and expertise within the Hadoop environment and big data technologies.
Resolve technical issues through debugging, research and / or investigation.
Work closely with a geographically distributed team
Contribute to the intellectual property of the team and the organization overall.
Mentoring and guiding junior members in the team, help them develop solution and resolve technical blockers.
Basic Qualifications :
Current Hands on Experience in Big Data Technologies, Java, Python with minimum of 8 years of experience.
Deep understanding and expertise within the Hadoop environment using technologies such as HDFS, MapReduce, Tez, Hive, Spark / Spark Streaming, Kafka and other big data technologies.
Application Development background in Java, Python, Scala, Sql.
Hand on experience working with public clouds like AWS, Google Cloud Platform solutions., Azure etc.
Demonstrated ability in data ingestion, data cleansing, ETL, Oozie workflows xmls
Strong analytical and problem solving skills, excellent team player.