SRE Data Specialist_Senior Assocaite_Enterprise Data

DBS Bank

Hyderabad , Telangana, India

2d ago

SRE Data Specialist Senior Assocaite Enterprise Data-(WD34160)

Duties and responsibilities

Implementing and maintaining Big Data tools and frameworks required to provide requested capabilities.

A strong team player, who can own responsibility for one or two open source / enterprise tool

Work with stakeholders including the Product owner, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

Support customers implementing ETL process

Monitoring performance and advising any necessary infrastructure changes

Responsible for implementation and ongoing administration of Hadoop infrastructure.

Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.

Cluster maintenance as well as creation and removal of nodes using tools like Grafana, Cloudera Manager Enterprise.

Performance tuning of HadoL2op clusters and Hadoop MapReduce, Spark routines.

Monitor Hadoop cluster connectivity and security

Manage and review Hadoop log files.

File system management and monitoring.

Requirements

Minimum 5 - 12 years professional experience as SRE and doing L2 / L3 production support, practices and skills or in IT operations in a financial institution.

Strong programming and scripting skills C++, Java, shell scripts, Python, etc

Candidate with work experience of 2+ years on any one of the below tool’s operations should be given preferenceKafkaCDHOpen shiftJ2EE / Spring BootAnsibleKubernetesMySQLHiveTableauDruidJenkins Pipeline

Good knowledge of Big Data querying tools, such as Presto and Hive, and Druid

Knowledge of Hadoop, Spark, Hive, S3

Knowledge of cloud native applications on AWS or, Azure or, GCP

Good knowledge of stream-processing systems, using solutions such as Flink or Spark-Streaming

Good knowledge of Kubernetes

Should have basic knowledge of DB(Mysql,PSQL,Hive )..DDL,DML

Experience with integration of data from multiple data sources

Experience with NoSQL databases, such as HBase, Cassandra, MongoDB

Knowledge of various ETL techniques and frameworks

Experience with various messaging systems, such as Kafka or RabbitMQ

Storage - SQL, MariaDB, Apache HBase

Knowledge of CI-CD - Maven, Git, Jenkins

Monitoring - ELK, Grafana, Prometheus

Good understanding of Lambda Architecture, along with its advantages and drawbacks

Good to have 3+ years Big Data Operation experience

Knowledge of FileSystem, FileTypes good to have.

High-level analytical and problem-solving skills.

Good project management and communication skills.

Well versed with SRE practices

Proficient understanding of distributed computing principles

Bachelor's degree in Computer Science or a related field. At least (5 - 12) years of IT experience of which at least (5) years' experience in similar role, ideally in a Big Data tools.

Report this job

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.