Sign up with

Already have an account? Log in here

Need some help?
Talk to us at +91 7670800001

Python Developer ( Web Scraping) at Weekday AI

Pune, maharashtra, India -

Full Time

Start Date

Immediate

Expiry Date

31 Mar, 26

Salary

600000.0

Posted On

31 Dec, 25

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, Web Scraping, Scrapy, Selenium, Playwright, BeautifulSoup, Requests, Linux, Git

Industry

technology;Information and Internet

Description

This role is for one of the Weekday's clients Salary range: Rs 200000 - Rs 600000 (ie INR 2-6 LPA) Min Experience: 1 years Location: Pune JobType: full-time The Python Developer (Web Scraping) will be responsible for building, maintaining, and scaling web scraping systems capable of efficiently handling large volumes of structured and unstructured data. This role focuses on reliability, performance optimization, and automation of data extraction workflows. Key Responsibilities Maintain, enhance, and optimize existing web scraping and data extraction frameworks. Identify and resolve scraping failures, website bans, CAPTCHAs, and performance bottlenecks. Develop robust Python scripts for scheduled and periodic data collection. Scale scraping pipelines to support high-volume and distributed data extraction. Monitor scraper health and ensure data accuracy, consistency, and completeness. Collaborate with internal teams to improve scraping efficiency and reliability. Implement best practices for code quality, performance, and maintainability. Required Skills & Experience 1+ year of hands-on experience in Python-based web scraping. Strong proficiency with scraping frameworks and libraries such as: Scrapy Selenium Playwright Requests BeautifulSoup (bs4) Solid understanding of HTML5, CSS3, JavaScript, and dynamic web pages. Strong Linux command-line skills. Experience using Git for version control. Ability to debug scraping issues related to website changes or anti-bot mechanisms. Good to Have Experience working with databases for storing and managing scraped data. Familiarity with scheduling tools or task automation. Exposure to proxy management, IP rotation, or CAPTCHA-solving techniques. Skills Python · Web Scraping · Scrapy · Selenium · Playwright · BeautifulSoup · Requests · Linux · Git

Responsibilities

The Python Developer will maintain, enhance, and optimize web scraping systems for data extraction. They will also identify and resolve scraping failures and ensure data accuracy and consistency.