Web Scraper - Python/Crawling (1-4 yrs) Mumbai (Systems/Product Software)
Executive Management
Mumbai, India
8d ago
source : hirist.com

Job Responsibilities :

  • As a Python Developer, your role is to apply your knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
  • Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store this data
  • Work closely with Database Administrators to store data in SQL and NoSQL databases
  • Develop frameworks for automating and maintaining constant flow of data from multiple sources
  • Work independently with little supervision to research and test innovative solutions
  • Skills and Qualifications :

  • Strong coding experience in Python (knowledge of Java, Javascripts is a plus) Database NoSQL, MongoDB, Other DB Technology, Elastic Search / Apache Solr, Kafka, Hadoop / Cassandra
  • Experience with SQL and NoSQL databases
  • Experience with multi-processing, multi-threading and AWS / Azure
  • Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web- Harvest and others
  • Previous experience with web crawling is a must
  • Step 2
    Add to favorites
    Remove from favorites
    My Email
    By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
    Application form