At Wiremind, our goal since we started in 2014 is to create optimization systems for the transport, logistics, sports and hospitality industries, without compromising on user experience. We build solutions that blend great design with cutting-edge technology to process vast quantities of data.
This leads us to work on many different kinds of projects: forecasting the demand for railway passengers between two major cities, handling millions of data points that we collect everyday through web-crawling, calculating the optimal way to fill an aircraft pallet with boxes of multiples dimensions and show the result in 3D, handle bookings in real time for major european football clubs.
Our applications are used daily by hundreds of users among the largest players of each industry (railway companies, airlines, etc.) in many countries and several continents.
We are now a team of 120+, growing about +100% every 18 months.
Our business model is built on “software-as-a-service” solutions licensed through long-term contracts, allowing our strong growth to be based on strong profitability – without requiring any fundraising.

WHAT YOU WILL DO

With the support of the product team, the lead scraping engineer is responsible for:

• Implement new scrapers and/or modify existing broken ones
• Prioritize and defend a technical roadmap to balance technical debt, product roadmap and implementation and scaling customer scraping plans
• Take part in maintenance tasks, application monitoring and infrastructure management. Our solution uses dozens of services which are carefully monitored.
• Exchange with the anti-ban squad to follow their developments and construct their roadmap.
• Mentor and manage the team by reviewing their merge request, distribution the daily tasks, set up a monitoring team for daily operational support, conduct the bi-yearly interviews
• Report to and construct the tech roadmap with the founder and CTO of Wiremind

At Wiremind, the scraping team is responsible for scraping the web to uncover our customer’s competitors prices. By simulating travel queries on travel reservation websites through complex scraping mecanism mimicking human behaviors, the scraping team gathers billions of data point every day. The team is divided in:

• a product squad handling the interface with customers, sales meeting, and overview the sprints
• an anti-ban squad responsible to develop a scraping framework capable of handling our scraping workload without being flagged and banned as scrapers
• a scraping team using the scraping framework to develop and maintained a set of scrapers to implement the product roadma