Data Automation Engineer - Scraping
ITH Technologies
Delhi, IN
6d ago
source : hirist.com

Responsibilities br>br> Own architecture, design, development, and implementation of different scraping modulesbr>br> Scrape difficult websites by deploying antiblocking and anticaptcha tools.

br>br> Develop frameworks for automating and maintaining the constant flow of data from multiple sources.br>br> Bring in industry best practicesbr>br> Discover opportunities for performance improvementsbr>br> Recommend ways to improve reliability, efficiency and code qualitybr>br> Focus on continuous delivery and reducing complexitybr>br> Strong data analysis skills working with data quality, data consolidation and data wrangling projects.

br>br>Requirements br>br> Overall 2 5 years of experience in Data automation & scrapingbr>br> Strong object oriented design skills & knowledge of design patternsbr>br> Experience in working with data platform & data lake pipeline building is preferred.

br>br> Knowledge on Selenium, Beautiful Soup, Java, Python, HTMLCSS, Scrapy, Jsoup, SQL is mustbr>br> Knowledge on Apache Spark, Druid, Kafka, Hive is a plusbr>br> Wellaware of and enforces development best practices Unit Tests, Code Reviews, Integration Tests, CICD, Monitoring, Alerting, etc.

Report this job
checkmark

Thank you for reporting this job!

Your feedback will help us improve the quality of our services.

Apply
My Email
By clicking on "Continue", I give neuvoo consent to process my data and to send me email alerts, as detailed in neuvoo's Privacy Policy . I may withdraw my consent or unsubscribe at any time.
Continue
Application form