What You'll Do

• Build eval harnesses and benchmarks using tracked pricing outcomes as ground truth for model quality.
• Systematize and automate expert review workflows that are currently handled manually.
• Develop AI personas that simulate B2B buying committees using usage data and call transcripts.
• Automate persona training pipelines and reduce reliance on manual processes.
• Own LLM routing across multiple providers with explicit cost, latency, and quality tradeoffs.
• Maintain infrastructure and data residency boundaries (e.g., keeping EU model calls within the EU).
• Extend the MCP server used by LLM agents so that features are agent-driven, not just UI-rendered.
• Work within a typed ontology of pricing entities to ensure model outputs are structured and auditable.
• Identify and remediate systemic latency, data drift, and cold-start issues in the pricing loop.
• 
  

What We're Looking For

• 8+ years of engineering experience with strong, recent production LLM depth.
• Proven track record shipping and owning LLM-powered product features end-to-end — from development through production monitoring.
• Hands-on experience building eval harnesses and observability for LLM systems, including baselining prompts against a typed ontology for release gating.
• Experience with MCP or building tools for LLM agents; familiarity with platforms such as LangChain, LlamaIndex, Braintrust, or OpenRouter is a plus.
• Experience with structured data models and typed ontologies (e.g., Pydantic) to land model outputs in auditable, structured form.
• Background operating under data residency, SOC2, and GDPR constraints — ideally in pricing, billing, or payments domains where accuracy is audited.
• Strong communication skills to explain non-deterministic systems to clients, pricing experts, and non-technical stakeholders.
• Comfortable with ambiguity and high ownership in a lean, fast-moving startup environment.
• Must be authorized to work in the United States; visa sponsorship is not available.
• 
  

Compensation & Benefits

Salary range: $225,000 – $255,000 USD annually. Visa sponsorship is not available.

• Location