Design, architect and maintain Hadoop platform ecosystem for a stable and efficient application layer integration.
Ensure Hadoop platform stability, availability by proactively monitoring clusters, resolving cluster issues and fixing issues to ensure they do not repeat.
Work with engineering, data science analytics and application teams to scope, size, install and configure components of Hadoop Data platforms.
Engage with other architects of application teams at Walmart for providing guidance in right technologies for application development and maintenance.
Maintain industry expertise by reviewing and conducting POCs on new technologies; and participating in continuing education and training.
Evaluate right technology needs based on business needs and work with team to adapt to those technologies.
Provide technical mentor-ship to associates.
Enable team to contribute to open source community.
Ensure that business needs are being met by evaluating the ongoing effectiveness of current plans, programs, and initiatives;
consult with business, partners, managers, coworkers, or other key stakeholders; solicit, evaluate, and apply suggestions for improving efficiency and cost effectiveness.
Engage with technical experts in setting up priorities for the team and in delivering best services to the customers around the globe.
Promote and support company policies, procedures, mission, values, and standards of ethics & integrity.
A strong technical staff engineer, who is ready to embrace technical challenges in a dynamic environment with excellent communication skills.
Should have skill sets for building high performance engineering teams that can work across multiple geographies, with strong customer focus and deliver big.
Data services across multiple technologies.
10+ years experience in Big data and related technologies.
Experience installing production grade Hadoop clusters, including configuration of Hadoop services (HBase, Impala, Hive, Hue, HDFS).
5+ years experience with production Hadoop platform administration (any of Cloudera, Hortonworks, MapR, Apache Foundation Hadoop) including monitoring tools such as Nagios, Ganglia, Cloudera Manager and Ambari.
Experience in architecting Hadoop security methodologies, performance and capacity management, backup and disaster recovery and high availability solutions.
Demonstrated ability in cluster optimization and recommend best practices for a Hadoop cluster.
Experience in debugging and analyzing Hadoop platform and services issues.
Knowledge on data ingestion and processing framework along with data security and governance.
Experience with Hadoop deployments in cloud environments (AWS, GCP, Azure, Rackspace, etc).
Should have strong coding skills in scripting languages such asShell, Perl, Python etc.
Performing Linux level package installation, internal and external repository management.
Led and mentored a team of highly skilled Hadoop Administrators.
Design solutions related to complex problems related to HDFS administration and guide team in arriving at right solutions.
Ability to work with distributed teams in a collaborative and productive manner.
Utilize industry research to improve Walmart's Big Data environment.