Big Data Operations- Sr Data Warehouse Engineer
Neustar
Hyderabad, Telangana
6d ago

Job Description :

Neustar is revitalizing its engineering and operations culture to adopt modern software design and delivery techniques as well as overall improved support functions.

We are looking for intellectually passionate people who learn quickly, thrive in a fast-paced environment, and stay current with the latest technologies.

We want people who fit our emerging Agile / DevOps culture, enjoy exploring and learning from differing opinions, and have a high level of engagement.

Our technology portfolio is expansive and new technologies are added regularly. Candidates must be able to adapt to new technologies quickly.

We want someone who will help maintain, troubleshoot, and support the platforms on which we develop software and operate our service.

Responsibilities :

The candidate will be responsible for ingesting, storing, validating and transforming data in a consumable format for business intelligence teams and data analysts to get deeper business insight from the data.

Design and implement Big Data analytic solutions on a Hadoop and GreenPlum (Postgres) based platform. The candidate will routinely work closely with infrastructure, network, database, business intelligence and application teams to ensure business applications are performing within agreed on service levels.

  • Work with team of Big Data resources supporting 24x7 Operational responsibilities. To ensure Big Data platform and job processing completes and meets operational service levels.
  • Design and develop ETL pipeline for collecting, validating and transforming data according to the specification
  • Building, administering, maintaining, and scaling a big data platform based on the Hadoop and GreenPlum ecosystem with primary use cases around supporting data science, reporting, and other data-
  • driven functionality across the organization

  • Understand and support concepts of Hadoop eco system such as YARN, MapReduce, HDFS, HBase, Spark, Zookeeper, Pig and Hive.
  • Provide support for various Business Unit engineering and operations team using the Big Data Platforms
  • Implement data quality checks.
  • Monitor Hadoop cluster connectivity and performance.
  • Manage and analyze Hadoop log files.
  • Manage and analyze GreenPlum log files.
  • Perform routine maintenance of the ecosystem to ensure optimum performance
  • File system management and monitoring.
  • Develop and document best practices
  • Capture and report on monthly Key Performance Indicators
  • HDFS support and maintenance.
  • Responsible for the new and existing administration of Big Data infrastructure.
  • Skills and Knowledge :

  • Thorough understanding of the Hadoop infrastructure and solid theoretical knowledge of big data skills; skilled in ability to see the big picture and conceptualize and document creative solutions
  • Excellent oral and written communications skills
  • Strong interpersonal skills at all levels of management and ability to motivate employees / teams to apply skills and techniques to solve dynamic problems;
  • excellent teamwork skills

  • Ability to weigh various suggested technical solutions against the original business needs and choose the most cost-effective solution
  • Strong Problem Solving and creative thinking skills
  • Ability to multi-task and manage multiple assignments simultaneously
  • Experience working with geographically distributed teams
  • Experience :

  • Bachelor’s degree or better in Computer Science, Engineering or related discipline
  • 2+ years in-depth experience in administration and support of Enterprise Hadoop (Community, Cloudera or Hortonworks)
  • 1+ years of experience with distributed database GreenPlum and / or Postgres
  • 3+ years of operating knowledge of various UNIX environments, specifically RedHat and CentOS
  • 3+ years UNIX shell scripting experience
  • 3+ years Python or Java development
  • Demonstrated experience working well with customers of varying levels of technical expertise in high-pressure situations and complex environments
  • Knowledge of scripting languages (Bash, Ruby, Perl) and at least one SQL variant preferred
  • Experience with using code repository management solutions
  • Neustar does not accept unsolicited resumes from external firms or agencies. Neustar will not be responsible for placement fees associated with unsolicited resumes.

    DIVERSITY

    Diversity, inclusion and teamwork are second nature to Neustar; and these values permeate our entire business structure.

    Neustar is committed to creating an environment where a wide spectrum of opinions and beliefs are actively sought, listened to and respected.

    Further, our talented workforce draws from the many geographic areas and markets in which Neustar operates worldwide, which represents a distinct competitive advantage.

    The rich and varied personal and professional backgrounds of our employees make Neustar a dynamic and rewarding company at which to build a career. We invite you to join us.

    EOE ofMinorities / Females / Vets / Disability

    Neustar, Inc. considers all applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, or status as a Vietnam-

    era or special disabled veteran in accordance with federal law and other state and local requirements. Neustar, Inc., complies with applicable state and local laws prohibiting discrimination in employment and provides reasonable accommodation to qualified individuals with disabilities in accordance with the American with Disabilities Act (ADA) and applicable state and local laws.

    Apply
    Add to favorites
    Remove from favorites
    Apply
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Continue
    Application form