SRE Data Specialist_Senior Assocaite_Enterprise Data
DBS Bank
Hyderabad , Telangana, India
2d ago

SRE Data Specialist Senior Assocaite Enterprise Data-(WD34160)

Duties and responsibilities

  • Implementing and maintaining Big Data tools and frameworks required to provide requested capabilities.
  • A strong team player, who can own responsibility for one or two open source / enterprise tool
  • Work with stakeholders including the Product owner, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Support customers implementing ETL process
  • Monitoring performance and advising any necessary infrastructure changes
  • Responsible for implementation and ongoing administration of Hadoop infrastructure.
  • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments.
  • Cluster maintenance as well as creation and removal of nodes using tools like Grafana, Cloudera Manager Enterprise.
  • Performance tuning of HadoL2op clusters and Hadoop MapReduce, Spark routines.
  • Monitor Hadoop cluster connectivity and security
  • Manage and review Hadoop log files.
  • File system management and monitoring.
  • Requirements

  • Minimum 5 - 12 years professional experience as SRE and doing L2 / L3 production support, practices and skills or in IT operations in a financial institution.
  • Strong programming and scripting skills C++, Java, shell scripts, Python, etc
  • Candidate with work experience of 2+ years on any one of the below tool’s operations should be given preferenceKafkaCDHOpen shiftJ2EE / Spring BootAnsibleKubernetesMySQLHiveTableauDruidJenkins Pipeline
  • Good knowledge of Big Data querying tools, such as Presto and Hive, and Druid
  • Knowledge of Hadoop, Spark, Hive, S3
  • Knowledge of cloud native applications on AWS or, Azure or, GCP
  • Good knowledge of stream-processing systems, using solutions such as Flink or Spark-Streaming
  • Good knowledge of Kubernetes
  • Should have basic knowledge of DB(Mysql,PSQL,Hive )..DDL,DML
  • Experience with integration of data from multiple data sources
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
  • Knowledge of various ETL techniques and frameworks
  • Experience with various messaging systems, such as Kafka or RabbitMQ
  • Storage - SQL, MariaDB, Apache HBase
  • Knowledge of CI-CD - Maven, Git, Jenkins
  • Monitoring - ELK, Grafana, Prometheus
  • Good understanding of Lambda Architecture, along with its advantages and drawbacks
  • Good to have 3+ years Big Data Operation experience
  • Knowledge of FileSystem, FileTypes good to have.
  • High-level analytical and problem-solving skills.
  • Good project management and communication skills.
  • Well versed with SRE practices
  • Proficient understanding of distributed computing principles
  • Bachelor's degree in Computer Science or a related field. At least (5 - 12) years of IT experience of which at least (5) years' experience in similar role, ideally in a Big Data tools.
  • Report this job
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form