I. POSITION SUMMARY:

The Web Scraping Analyst will lead the development and execution of data collection pipelines by extracting structured information from websites and directories. This role is responsible for building and maintaining web scraping scripts and ensuring the accuracy, usability, and consistency of the output data across internal use cases.

EDUCATION:

• Bachelor’s degree in Computer Science, Data Science, Information Technology, or a related field (or equivalent experience).

EXPERIENCE:

• Min. of 3 years of experience in web scraping, automation scripting, or data extraction.
• Demonstrated experience extracting data from structured and unstructured sources such as business directories, vendor lists, and company profiles (e.g., Crunchbase).

TECHNICAL SKILLS:

• Proficiency in Python and web scraping libraries such as BeautifulSoup, Scrapy, Selenium, and Pandas.
• Experience working with Excel and CSV file generation using Python.
• Familiarity with HTML, CSS selectors, XPath, and JSON structures.
• Basic knowledge of databases (SQL, MongoDB) and APIs.
• Familiarity with version control tools like Git.

SOFT SKILLS:

• Detail-oriented and committed to data accuracy.
• Self-motivated with strong time management skills.
• Ability to communicate effectively with both technical and non-technical team members.
• Proactive and resourceful when troubleshooting scraping issues or adapting to website changes.

• WEB SCRAPING DEVELOPMENTDevelop and maintain scalable web scraping scripts using Python (e.g., BeautifulSoup, Scrapy, Selenium) to extract data from multi-page directories and detailed company listings.
• DATA OUTPUT AND FORMATTINGCreate structured Excel/CSV outputs with required fields such as company name, country, website, LinkedIn, city, and state.
• DATA QUALITY AND ANALYSISAnalyze scraped data to identify patterns, gaps, or inconsistencies and ensure outputs are aligned with project goals. Perform thorough quality checks and validate data before delivery.
• SCRAPING AUTOMATION AND MONITORINGSchedule, monitor, and maintain scraping jobs to ensure consistent data extraction and uptime.
• COLLABORATION AND REQUIREMENT GATHERINGCollaborate with internal teams to define data needs and translate requirements into actionable scraping tasks.
• PERFORMANCE OPTIMIZATIONContinuously improve the performance and scalability of scraping tools and workflows.
• SECURITY AND CONFIDENTIALITYHandle all data and scraping activities in a secure manner, ensuring protection of sensitive or proprietary data in line with internal policies.