Lead Software Engineer - Test Frameworks and Tooling Team at Klaviyo

Boston, Massachusetts, United States -

Full Time

Start Date

Immediate

Expiry Date

20 Apr, 26

Salary

282000.0

Posted On

21 Jan, 26

Experience

10 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Software Engineering, CI/CD, Quality Engineering, Root-Cause Analysis, Full-Stack Development, AI Integration, Debugging, Architectural Vision, Testing Frameworks, Python, React, Django, Go, AWS, Kubernetes, Terraform

Industry

Marketing Services

Description

At Klaviyo, we value the unique backgrounds, experiences and perspectives each Klaviyo (we call ourselves Klaviyos) brings to our workplace each and every day. We believe everyone deserves a fair shot at success and appreciate the experiences each person brings beyond the traditional job requirements. If you’re a close but not exact match with the description, we hope you’ll still consider applying. Want to learn more about life at Klaviyo? Visit careers.klaviyo.com to see how we empower creators to own their own destiny. Why You Should Join the Test Frameworks and Tooling Team Engineering confidence is our primary product. We are not testers, but rather infrastructure architects building the sophisticated automation and CI/CD frameworks that make deploying to production a non-event. As the Lead for this team, you will define the technical roadmap for our automated guardrails and repository standards, empowering every engineer in the company to ship at terminal velocity with total confidence. By architecting the foundational tools that guarantee production readiness, you will play a pivotal role in driving Sev-1 incidents toward zero and ensuring our organization can move fast without the fear of breaking things. What You'll Achieve: Key Responsibilities As the technical leader for this team, you will drive the evolution of our testing ecosystem and mentor other engineers in the craft of quality engineering: Define Architectural Vision: Lead the long-term strategy for our integration and E2E testing frameworks across both backend and frontend stacks. You will ensure these systems are not just reliable, but world-class in their ease of adoption. CI/CD Strategy: Architect how we execute tests within our CI system. You will focus on radically optimizing feedback loops so that engineers receive actionable, high-fidelity results in minutes. Set Engineering Standards: Establish the "golden paths" for our repositories. You will define the benchmarks for unit testing, code quality metrics, and systemic reliability that all teams will follow. Scalable Tooling & Coverage: Design and build the next generation of tools that simplify complex testing scenarios. You will lead efforts to backfill testing gaps at scale through advanced data mocking and service isolation. AI-Driven Quality Strategy: Spearhead our efforts to leverage AI within the testing lifecycle. You will identify and implement AI-powered solutions for automated regression detection, flaky test analysis, and intelligent test generation. Cross-Functional Leadership: Act as a consultant to feature teams to solve their most complex stability challenges. You will use root-cause analysis from major incidents to propose and implement pillar-wide safety improvements. Operational Excellence: Oversee the health and performance of our entire CI/CD pipeline, taking ultimate responsibility for the stability of the environment that hundreds of engineers rely on daily. You’ve already experimented with AI in work or personal projects, and you’re excited to dive in and learn fast. You’re hungry to responsibly explore new AI tools and workflows, finding ways to make your work smarter and more efficient. What Makes This Role Exciting High-Leverage Leadership: You are not just building features; you are building the platform that defines the developer experience for the entire company. Innovation at the Edge: You will have the autonomy to experiment with emerging technologies like AI and LLMs to solve the age-old problems of flakiness and slow feedback loops. Pillar-Wide Influence: As a Lead, your decisions on testing standards and infrastructure will directly impact the speed and quality of every shipping team in the organization. Who You Are: Seasoned Technical Leader: You have 7+ years of software engineering experience with a history of leading complex, high-impact technical projects. You are a hands-on lead who stays close to the code while steering the broader vision. Master of Root-Cause Analysis: You don't just fix symptoms; you hunt down systemic failures. You excel at debugging deep-stack issues and transforming those lessons into automated preventions. Full-Stack Architect: You are comfortable designing systems across the stack. Whether it is a React-based quality dashboard or a Python service for data seeding, you understand how to build for scale. AI Visionary: You are passionate about the intersection of AI and Software Quality. You have a clear perspective on how AI can automate the mundane parts of testing and accelerate the SDLC. Extreme Ownership: You take pride in the end-to-end health of the platform. You are proactive in identifying technical debt and are a relentless advocate for engineering excellence. CI/CD Expert: You have deep experience with modern CI/CD tools and a sophisticated understanding of how to integrate automated testing into high-frequency deployment pipelines. Technologies we use (not exhaustive): Backend: Python, Django, Go Frontend: React, TypeScript, JavaScript Testing Frameworks: Playwright, Cypress, Pytest, Jest Infrastructure and CI: AWS, Kubernetes, Terraform, Helm, Buildkite Data: MySQL, Redis, Kafka AI Tools: Integration with Claude, Cursor, Copilot, or internal AI enablement frameworks Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. Our salary range reflects the cost of labor across various U.S. geographic markets. The range displayed below reflects the minimum and maximum target salaries for the position across all our US locations. The base salary offered for this position is determined by several factors, including the applicant’s job-related skills, relevant experience, education or training, and work location. In addition to base salary, our total compensation package may include participation in the company’s annual cash bonus plan, variable compensation (OTE) for sales and customer success roles, equity, sign-on payments, and a comprehensive range of health, welfare, and wellbeing benefits based on eligibility. Your recruiter can provide more details about the specific salary/OTE range for your preferred location during the hiring process. Base Pay Range For US Locations: $188,000—$282,000 USD Get to Know Klaviyo We’re Klaviyo (pronounced clay-vee-oh). We empower creators to own their destiny by making first-party data accessible and actionable like never before. We see limitless potential for the technology we’re developing to nurture personalized experiences in ecommerce and beyond. To reach our goals, we need our own crew of remarkable creators—ambitious and collaborative teammates who stay focused on our north star: delighting our customers. If you’re ready to do the best work of your career, where you’ll be welcomed as your whole self from day one and supported with generous benefits, we hope you’ll join us. AI fluency at Klaviyo includes responsible use of AI (including privacy, security, bias awareness, and human-in-the-loop). We provide accommodations as needed. By participating in Klaviyo’s interview process, you acknowledge that you have read, understood, and will adhere to our Guidelines for using AI in the Klaviyo interview Process. For more information about how we process your personal data, see our Job Applicant Privacy Notice. Klaviyo is committed to a policy of equal opportunity and non-discrimination. We do not discriminate on the basis of race, ethnicity, citizenship, national origin, color, religion or religious creed, age, sex (including pregnancy), gender identity, sexual orientation, physical or mental disability, veteran or active military status, marital status, criminal record, genetics, retaliation, sexual harassment or any other characteristic protected by applicable law. IMPORTANT NOTICE: Our company takes the security and privacy of job applicants very seriously. We will never ask for payment, bank details, or personal financial information as part of the application process. All our legitimate job postings can be found on our official career site. Please be cautious of job offers that come from non-company email addresses (@klaviyo.com), instant messaging platforms, or unsolicited calls. By clicking "Submit Application" you consent to Klaviyo processing your Personal Data in accordance with our Job Applicant Privacy Notice. If you do not wish for Klaviyo to process your Personal Data, please do not submit an application. You can find our Job Applicant Privacy Notice here and here (FR).

Responsibilities

As the technical leader, you will drive the evolution of the testing ecosystem and mentor engineers in quality engineering. You will define the architectural vision, establish engineering standards, and oversee the CI/CD pipeline's health and performance.