Senior Engineer DNA Spark
Neustar, Inc.
Hyderabad, Telangana, IN
5d ago

The Senior Engineer of DNA Spark is a data and technical leader responsible to design and develop the next generation of data processing on Hadoop / Spark platform.

The technical leader in this role will work closely with various teams including data acquisition, data products & data sciences to build the web services platform exposing these services to the end customers.

The role is based out of India at the Neustar's offices in either Bangalore or Hyderabad. This role will report to the Director of Data and Analytics.

Responsibilities :

  • Leading the team, designing and developing the data processing & ML code on Spark.
  • Prototype and program data transformations and entity resolutions on petabyte-scale data on Hadoop / Spark clusters.
  • Understand the data patterns and design and implement the code and debug ML models for entity resolution in Spark. Work on Spark code performance improvement.
  • Run along the cutting edge with an all-star lineup of experts in computer science, software engineering, marketing science, operation research and marketing strategy.
  • Skills and Experience :

  • Bachelor’s degree in computer science or engineering discipline (master degree preferred)
  • 7-10 years of experience in information technology and information services domain
  • 3+ years of experience in the ETL or Analytics domain with significant hands on experience
  • Adept at data architecture, data platforms and ecosystem tools, technologies and applications. Experience with the latest data and digital ecosystem related to marketing, advertising, security, internet of things and related domains is a plus
  • Adept in the use of big data, business intelligence and analytics with significant past deliveries and achievements using SQL, Map-
  • Reduce, Spark and other distributed computing frameworks including cloud (AWS, Azure etc.)

  • Adept at data pre-processing, complex data transformations using ETL / ELT technologies and SQL as well as NOSQL technologies, relational as well as graph databases and data API frameworks to query data off these databases
  • Good hands-on programing skills in Java, Python and Scala.
  • Fast executor with a track record of delivering complex projects on time; responds under pressures of time and uncertainty
  • Hands on experience with continuous integration and continuous deployment tools including Chef, Jenkins etc.
  • Strong written, editing, proofreading and oral communication
  • Strong inter-personal communication and collaboration skills
  • Nice to have :

  • Experience in implementing entity resolution models in Spark / experience in digital marketing, advertising domains is a plus
  • Experience in using Spark graph libraries will be a definite advantage
  • Why work with us?

  • Because you love to build beautiful, innovative solutions that wow the customer
  • Because you believe in changing the status quo and are up for the challenge of your life
  • Because you know you can make a difference to people, places and things!
  • About Us

    Every day, the world generates roughly 2.5 quadrillion bits of data. Neustar isolates certain elements and analyzes, simplifies and edits them to make precise and valuable decisions that drive results.

    As one of the few companies capable of knowing with certainty who is on the other end of every interaction, we’re trusted by the world’s great brands to make critical decisions some 20 billion times a day.

    Neustar does not accept unsolicited resumes from external firms or agencies. Neustar will not be responsible for placement fees associated with unsolicited resumes.


    Diversity, inclusion and teamwork are second nature to Neustar; and these values permeate our entire business structure.

    Neustar is committed to creating an environment where a wide spectrum of opinions and beliefs are actively sought, listened to and respected.

    Further, our talented workforce draws from the many geographic areas and markets in which Neustar operates worldwide, which represents a distinct competitive advantage.

    The rich and varied personal and professional backgrounds of our employees make Neustar a dynamic and rewarding company at which to build a career. We invite you to join us.

    Neustar, Inc. considers all applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, or status as a Vietnam-

    era or special disabled veteran in accordance with federal law and other state and local requirements. Neustar, Inc., complies with applicable state and local laws prohibiting discrimination in employment and provides reasonable accommodation to qualified individuals with disabilities in accordance with the American with Disabilities Act (ADA) and applicable state and local laws.

    Add to favorites
    Remove from favorites
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form