Business Unit : Position Summary The dx Team has responsibility including Data Engineering in DevOps Model for Comcast; one of the major goal is to harmonize the data ingestion and consumption layer across Comcast.
Creating enterprise data sources as a single version of truth is a goal of dx Team. The Big Data Software Developer will develop (code / program), test, debug -ETL (Extract / Transform / Load) of data to answer technically challenging business requirements (complex transformations, high data volume).
All work needs to be documented. Employees at all levels are expect to :
Understand our Operating Principles; make them the guidelines for how you do your job
Own the customer experience - think and act in ways that put our customers first, give them seamless digital options at every touchpoint, and make them promoters of our products and services
Know your stuff - be enthusiastic learners, users and advocates of our game-changing technology, products and services, especially our digital tools and experiences
Win as a team - make big things happen by working together and being open to new ideas
Drive results and growth
Respect and promote inclusion and diversity
Do what's right for each other, our customers, investors and our communities Core Responsibilities
Analyzes and determines data integration needs
Evaluates and plans software designs, test results and technical manuals using Big Data (Hadoop) ecosystem
Reviews literature, current practices relevant to the solution of assigned projects in Data Warehousing and Reporting areas.
Experience with DevOps tools (GitHub, Jira) and methodologies (Agile, Scrum, Kanban, Test Driven Development)
Hands on experience with Hadoop ecosystem tools like YARN, HDFS, Hive, Sqoop, understanding of systems performance data (collection, monitoring, analysis)
Hands on experience on Teradata Database Administration, knowledge of Teradata RDBMS at both physical and logical level working knowledge of Teradata suite of tools : Viewpoint, TASM , BTEQ, ARCMAIN, TPT, FASTOAD, MLOAD, TPUMP, DBQL, PDCR.
Collaborate with various cross functional teams; infrastructure, network, database and application for various activities : deployment of new software, environment, capacity, uplift
Performance tuning of Hadoop clusters and various Hadoop components and routines
Monitor job performances, file system / disk-space management, cluster and database connectivity, log files, management of backup / security and troubleshooting various user issues
Hadoop cluster performance monitoring and tuning, disk space management
Harden the cluster to support use cases like self-service in 24x7 model and apply advanced troubleshooting techniques to critical, highly complex customer problems
Contribute to the evolving Hadoop / EDW architecture of our services to meet changing requirements for scaling, reliability, performance, manageability and price
Work with various teams to setup new Hadoop users, security and platform governance
Create and execute capacity planning strategy process for the Hadoop platform
Edits and reviews technical requirements documentation
Displays knowledge of software engineering methodologies, concepts, skills and their application in the area of specified engineering specialty (like Data warehousing)
Displays knowledge of, and ability to apply, process software design and redesign skills
Displays in-depth knowledge of, and ability to apply, project management skills
Works independently, assumes responsibility for job development and training, researches and resolves questions and problems, requests supervisor input and keeps supervisor informed required
Consistent exercise of independent judgment and discretion in matters of significance
Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary
Other duties and responsibilities as assigned Compliance Disclaimer The above information has been designed to indicate the general nature and level of work performed by employees in this role.
It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Comcast is an EEO / AA / Drug Free Workplace. Comcast is an equal employment employer.