Hadoop Admin Staff Engineer
Walmart Labs
Bangalore, Karnataka, IN
12d ago
source : Instahyre

Responsibilities :

  • Design, architect and maintain Hadoop platform ecosystem for a stable and efficient application layer integration.
  • Ensure Hadoop platform stability, availability by proactively monitoring clusters, resolving cluster issues and fixing issues to ensure they do not repeat.
  • Work with engineering, data science analytics and application teams to scope, size, install and configure components of Hadoop Data platforms.
  • Engage with other architects of application teams at Walmart for providing guidance in right technologies for application development and maintenance.
  • Maintain industry expertise by reviewing and conducting POCs on new technologies; and participating in continuing education and training.
  • Evaluate right technology needs based on business needs and work with team to adapt to those technologies.
  • Provide technical mentor-ship to associates.
  • Enable team to contribute to open source community.
  • Ensure that business needs are being met by evaluating the ongoing effectiveness of current plans, programs, and initiatives;
  • consult with business, partners, managers, coworkers, or other key stakeholders; solicit, evaluate, and apply suggestions for improving efficiency and cost effectiveness.

  • Engage with technical experts in setting up priorities for the team and in delivering best services to the customers around the globe.
  • Promote and support company policies, procedures, mission, values, and standards of ethics & integrity.
  • Requirements :

  • A strong technical staff engineer, who is ready to embrace technical challenges in a dynamic environment with excellent communication skills.
  • Should have skill sets for building high performance engineering teams that can work across multiple geographies, with strong customer focus and deliver big.
  • Data services across multiple technologies.
  • 10+ years experience in Big data and related technologies.
  • Experience installing production grade Hadoop clusters, including configuration of Hadoop services (HBase, Impala, Hive, Hue, HDFS).
  • 5+ years experience with production Hadoop platform administration (any of Cloudera, Hortonworks, MapR, Apache Foundation Hadoop) including monitoring tools such as Nagios, Ganglia, Cloudera Manager and Ambari.
  • Experience in architecting Hadoop security methodologies, performance and capacity management, backup and disaster recovery and high availability solutions.
  • Demonstrated ability in cluster optimization and recommend best practices for a Hadoop cluster.
  • Experience in debugging and analyzing Hadoop platform and services issues.
  • Knowledge on data ingestion and processing framework along with data security and governance.
  • Experience with Hadoop deployments in cloud environments (AWS, GCP, Azure, Rackspace, etc).
  • Should have strong coding skills in scripting languages such asShell, Perl, Python etc.
  • Performing Linux level package installation, internal and external repository management.
  • Led and mentored a team of highly skilled Hadoop Administrators.
  • Design solutions related to complex problems related to HDFS administration and guide team in arriving at right solutions.
  • Ability to work with distributed teams in a collaborative and productive manner.
  • Utilize industry research to improve Walmart's Big Data environment.
  • Step 2
    Add to favorites
    Remove from favorites
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form