Software Engineer for AB Testing Platform (Remote)

at  Constructor

Constructor powers product search and discovery for some of the largest retailers in the world, like Sephora and Petco. We serve billions of requests every day, and you’ve probably seen our results somewhere and used our product without knowing it. We differentiate ourselves by focusing on metrics over features and reinventing search and discovery from the ground up as a machine learning challenge with the specific goal of improving metrics like revenue. We have grown several hundred percent YoY for the last 2 years and have customers in every eCommerce vertical, around the world, and spanning many languages.
We’re a passionate team of technologists who love solving problems and want to make our customers’ and coworkers’ lives better. We value empathy, openness, curiosity, and continuous improvement, and are excited by metrics that matter. We believe that empowering everyone in a company to do what they think is best can lead to great things.

REQUIREMENTS

The Experiments team builds tools to evaluate product hypotheses. We help other teams test their ideas to raise KPIs such as revenue and conversions.

Our team members solve a wide range of tasks, including:

• owning whole experimentation pipeline from traffic splitting to revealing experiment results
• developing the core internal experiments platform for ML teams to improve the quality of the product
• developing customer-facing headless experiments platform, allowing customers to launch their own experiments
• creating dashboards for key metrics
• improving the trustworthiness, necessary time, and number of experiments

As a member of the Experiments team, you will integrate state-of-the-art solutions for AB tests and develop a scalable and flexible system for the company and customers.

Challenges you will tackle

• Build and support the platform for AB tests and any necessary upstream services. That includes implementing user-facing features for running/analyzing experiments, improving performance and scalability of our services, and dealing with technical debt.
• Collaborate with technical and non-technical teams to develop and integrate solutions to improve platform functionality
• Improve business KPIs by providing a trustworthy solution for product changes

Requirements

• You have hands-on experience building services for production, with a good understanding of the full pipeline of development.
• You understand the necessity of monitoring and quality assurance for services that directly affect the customer’s experience.
• You are ready to dive into the technical details of the experimental/data analytics domain (ideally have experience with or a good understanding of AB testing and statistics or experience building AB experiments platform or other analytics tools)
• You’re curious about how people use the product you build, not just how it looks from the technical perspective
• It would be a great match if you have experience with PySpark and ETL pipelines.

Stack:

• Backend and user-facing services: Python, Plotly Dash, Flask/FastAPI, PostgreSQL, AWS S3
• Data pipelines: PySpark, Databricks, AWS S3, SQL
• Devops: AWS Cloudformation

We do not expect you to be proficient in all of these, but strong Python knowledge and backend development experience are required, as well as some experience with the aforementioned or similar big data processing tools.

• owning whole experimentation pipeline from traffic splitting to revealing experiment results
• developing the core internal experiments platform for ML teams to improve the quality of the product
• developing customer-facing headless experiments platform, allowing customers to launch their own experiments
• creating dashboards for key metrics
• improving the trustworthiness, necessary time, and number of experiment