Senior Software Engineer - Scraping

at  Octus formerly Reorg

OCTUS, FORMERLY REORG

Octus, formerly Reorg is a leading global provider of credit intelligence, data, and analytics. Since 2013, tens of thousands of professionals across hedge fund, investment banking, management consulting, and law firm verticals have come to rely on Octus, formerly Reorg to make better, faster, and more confident decisions in pace with the fast-moving credit markets. For more information, visit: https://octus.com/

REQUIREMENTS

• Strong understanding of technical design patterns and SOLID engineering principles.
• Expertise in Python development, particularly with web scraping libraries like Scrapy/Beautiful Soup.
• Proven experience in developing and maintaining large-scale web scraping solutions.
• Familiarity with C#/.NET technologies is a strong plus.
• Strong problem-solving skills and a proactive attitude.
• At least 6+ years of experience with Python and relevant data scraping tools.
• Experience mentoring engineering teams, particularly in the context of data extraction and scraping projects.
• Strong understanding of API design principles and best practices, especially as they relate to scraped data.
• Experience with CI/CD pipelines and automated testing frameworks.
• Familiarity with cloud platforms (AWS/GCP/Azure) for scalable scraping solutions.
• Experience with software development lifecycle tools such as JIRA, Confluence, GitHub, etc.
• Excellent communication and collaboration skills.
  At Reorg, we consider a range of factors in connection with compensation decisions, including experience, skills, location, and our business needs and limitations. As a result, compensation may vary within and across similar roles and positions. Please note that the salary range information below is a good faith estimate for this position and actual compensation for any individual may fall outside this range if warranted by the circumstances applicable to that individual. If we identify a role that would be suitable for a broader range of skills and experience such that we would consider hiring at multiple levels then the range listed below may reflect that breadth.
  The salary range estimate for this position is $160,000-$185,000.
  The actual compensation will be at Reorg’s sole discretion and will be determined by the aforementioned and other relevant factors. This position is eligible for an annual discretionary bonus.

ROLE

Reorg is looking for a Senior Engineer/Tech Lead to drive and own our web scraping initiatives. This role will lead the design, development, and maintenance of scalable scraping solutions as part of our data technology team. The ideal candidate is an expert Python developer with strong experience in web scraping and related technologies.

RESPONSIBILITIES

• Demonstrate a track record of effective technical leadership and hands-on technical mentorship to developers.
• Lead the design and development of web scraping applications and services, ensuring they are scalable, efficient, and meet performance requirements.
• Drive technical decisions, ensuring that best practices in web scraping, data extraction, and management are followed.
• Provide leadership in applying design patterns and adhering to SOLID engineering principles, with a focus on reusability, modularity, scalability, and fault tolerance.
• Utilize hands-on experience to design, build, and support web scraping solutions, particularly using Python and relevant libraries (e.g., Scrapy).
• Promote a culture of continuous improvement and high-quality code delivery.
• Partner with the broader technology leadership team to ensure service reliability through testing and release procedures.
• Stay current with industry trends in web scraping, data technologies, and emerging tools.
• Identify opportunities for innovation and process improvement in web scraping.
• Ensure compliance with security and firmwide architecture standards in web scraping activities.