Senior Software Engineer II, MLOps, Retrieval Infra

at  HubSpot

ABOUT THE ROLE:

HubSpot is at the forefront of empowering businesses with cutting-edge AI, and our MLOps Group is at the heart of this initiative. We are seeking a Senior Software Engineer with a passion for machine learning operations and data engineering to join our ML Retrieval Infra team.
The ML Retrieval Infra team is part of the MLOps whose goal is to provide infrastructure and tooling to Machine Learning Engineers to be able to excel in their work while also accelerating HubSpot Product & Engineering teams to adopt AI throughout the HubSpot product suite.
Specifically, the ML Retrieval Infra team owns the lower-level components to power retrieval-powered AI applications like RAG (Retrieval Augment Generation) or recommendation use cases. Some of those components include a VectorDB and the layers on top of it.

RESPONSIBILITIES:

Design & Develop Scalable Retrieval Infrastructure:

• Build and maintain the infrastructure powering retrieval-based AI features like Retrieval Augmented Generation and recommendation engines.
• Ensure the vector search engine is scalable, reliable, and easy to maintain by enhancing deployment, monitoring, and fault tolerance.
• Develop monitoring solutions to maintain the health and performance of the retrieval infrastructure.

Collaborate with AI and Product Engineering Teams:

• Partner with machine learning and product engineering teams to integrate retrieval infrastructure into HubSpot’s product ecosystem.
• Provide tooling and support to accelerate AI adoption and scaling across products.

Innovate in Retrieval Technologies:

• Stay current with advancements in retrieval, databases, and AI infrastructure, applying cutting-edge solutions to enhance HubSpot’s AI capabilities.
• Experiment with new retrieval strategies, AI model integration, and distributed systems to improve AI applications.

Ensure Data Security, Privacy, and Compliance:

• Implement security and compliance measures, including anonymization and encryption, to manage sensitive data in retrieval systems.
• Work with compliance teams to align retrieval infrastructure with HubSpot’s data governance policies.