AI Quality Lead -Virtual at ALIGHT SOLUTIONS LLC

, Illinois, United States -

Full Time

Start Date

Immediate

Expiry Date

03 Jun, 26

Salary

180000.0

Posted On

05 Mar, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

AI Quality, Strategy Design, SOP Implementation, Risk Tiering, Test Suites Development, Prompt Injection, Bias Testing, Functional Automation, UI/API Testing, Observability Instrumentation, Evaluation Harnesses, CI Gating, Red-Team Playbooks, Governance, Audit Evidence, LLM

Industry

Human Resources Services

Description

AI Quality Lead Amazing Opportunity and Great Place to Work! Are you a fast learner who is fascinated by technology? Our Story At Alight, we believe a company’s success starts with its people. At our core, we Champion People, help our colleagues Grow with Purpose and true to our name we encourage colleagues to “Be Alight.” Our Values Champion People – be empathetic and help create a place where everyone belongs. Grow with purpose – be inspired by our higher calling of improving lives. Be Alight – act with integrity, be real and empower others. It’s why we’re so driven to connect passion with purpose. Alight helps clients gain a benefits advantage while building a healthy and financially secure workforce by unifying the benefits ecosystem across health, wealth, wellbeing, absence management and navigation. With a comprehensive total rewards package, continuing education and training, and tremendous potential with a growing global organization, Alight is the perfect place to put your passion to work. Join our team if you Champion People, want to Grow with Purpose through acting with integrity and if you embody the meaning of Be Alight. Learn more at careers.alight.com. “This role supports services provided to the federal government or federal government contractor and therefore requires US Citizenship. Proof of citizenship status will be required at time of hire.” About the Role As the AI Quality Lead for the Artificial Intelligence Center of Excellence (AI CoE), you will architect and drive the end-to-end AI Quality program from inception. This is a hands-on leadership role, requiring both strategic vision and technical depth to go from 0→1 in AI Quality at Alight. Responsibilities Design and implement the unified AI Quality strategy and SOP, scaling controls by risk tier (Tier 1–3) Define and own success metrics, risk tiering, acceptance criteria, and operating thresholds for AI solutions Lead the development of golden/adversarial test suites (prompt injection, misuse, safety, bias, functional automation) Oversee the creation and maintenance of schema-level UI/API tests, agent contracts, and observability instrumentation Own the org-wide evaluation harnesses (e.g., promptfoo, TruLens, Ragas), CI gating, and red-team playbooks Manage independent spot checks, factsheets, registry entries, and evidence for governance and audit Collaborate with Product Owners, Developers, SRE/Observability, and Governance to ensure compliance and operational excellence Drive continuous improvement in fairness, explainability, safety, security, and operational SLOs Mentor and grow the AI Quality team, including onboarding and coaching junior engineers Experience with LLM, RAG, agentic, or classic ML systems Familiarity with test automation frameworks, CI/CD pipelines, and evaluation tools (promptfoo, TruLens, Ragas) Knowledge of fairness, explainability, safety, and security standards (e.g., OWASP Top 10, MITRE ATLAS, Fairlearn, AIF360) Experience with data integrity, lineage, and observability (OpenTelemetry, New Relic, OpenLineage) Familiarity with AI infrastructure, orchestration, data integrity, deployments, and model registry practices Knowledge of international standards and regulatory frameworks for Responsible AI Requirements Experience leading or building quality engineering or testing programs (AI/ML experience is a plus, but not required) Ability to design and implement test strategies, automation frameworks, and quality standards Excellent communication and leadership skills; ability to work cross-functionally and influence stakeholders. Experience with LLM, RAG, agentic, or classic ML systems Familiarity with test automation frameworks, CI/CD pipelines, and evaluation tools (promptfoo, TruLens, Ragas) Knowledge of fairness, explainability, safety, and security standards (e.g., OWASP Top 10, MITRE ATLAS, Fairlearn, AIF360) Experience with data integrity, lineage, and observability (OpenTelemetry, New Relic, OpenLineage) Familiarity with AI infrastructure, orchestration, data integrity, deployments, and model registry practices Knowledge of international standards and regulatory frameworks for Responsible AI Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field, or equivalent experience Flexible Working So that you can be your best at work and home, we consider flexible working arrangements wherever possible. Alight has been a leader in the flexible workspace and “Top 100 Company for Remote Jobs” 5 years in a row. Benefits We offer programs and plans for a healthy mind, body, wallet and life because it’s important our benefits care for the whole person. Options include a variety of health coverage options, wellbeing and support programs, retirement, vacation and sick leave, maternity, paternity & adoption leave, continuing education and training as well as a number of voluntary benefit options. By applying for a position with Alight, you understand that, should you be made an offer, it will be contingent on your undergoing and successfully completing a background check consistent with Alight’s employment policies. Background checks may include some or all the following based on the nature of the position: SSN/SIN validation, education verification, employment verification, and criminal check, search against global sanctions and government watch lists, credit check, and/or drug test. You will be notified during the hiring process which checks are required by the position. Our commitment to Inclusion We celebrate differences and believe in fostering an environment where everyone feels valued, respected, and supported. We know that diverse teams are stronger, more innovative, and more successful. At Alight, we welcome and embrace all individuals, regardless of their background, and are dedicated to creating a culture that enables every employee to thrive. Join us in building a brighter, more inclusive future. As part of this commitment, Alight will ensure that people with disabilities are provided with reasonable accommodations for the hiring process. If reasonable accommodation is needed, please contact alightcareers@alight.com. Equal Opportunity Policy Statement Alight is an Equal Employment Opportunity employer and does not discriminate against anyone based on sex, race, color, religion, creed, national origin, ancestry, age, physical or mental disability, medical condition, pregnancy, marital or domestic partner status, citizenship, military or veteran status, sexual orientation, gender, gender identity or expression, genetic information, or any other legally protected characteristics or conduct covered by federal, state or local law. In addition, we take affirmative action to employ disabled persons, disabled veterans and other covered veterans. Alight provides reasonable accommodation to the known limitations of otherwise qualified employees and applicants for employment with disabilities and sincerely held religious beliefs, practices and observances, unless doing so would result in undue hardship. Applicants for employment may request reasonable accommodation/modification by contacting their recruiter. Authorization to work in the Employing Country Applicants for employment in the country in which they are applying (Employing Country) must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the Employing Country and with Alight. Note, this job description does not restrict management's right to assign or reassign duties and responsibilities of this job to other entities; including but not limited to subsidiaries, partners, or purchasers of Alight business units. #LI-Remote P&T2026 We offer you a competitive total rewards package, continuing education & training, and tremendous potential with a growing worldwide organization. Salary Pay Range Minimum : 125,000.00 USD Maximum : 180,000.00 USD Pay Transparency Statement: Alight considers a variety of factors in determining whether to extend an offer of employment and in setting the appropriate compensation level, including, but not limited to, a candidate’s experience, education, certification/credentials, market data, internal equity, and geography. Alight makes these decisions on an individualized, non-discriminatory basis. Bonus and/or incentive eligibility are determined by role and level. Alight also offers a comprehensive benefits package; for specific details on our benefits package, please visit: Wellbeing and Benefits Selector Page - Alight DISCLAIMER: Nothing in this job description restricts management's right to assign or reassign duties and responsibilities of this job to other entities; including but not limited to subsidiaries, partners, or purchasers of Alight business units. Alight Solutions provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, creed, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, pregnancy, childbirth or related medical condition, veteran, marital, parental, citizenship, or domestic partner status, or any other status protected by applicable national, federal, state or local law. Alight Solutions is committed to a diverse workforce and is an affirmative action employer.

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities

The AI Quality Lead will architect and drive the end-to-end AI Quality program from inception, requiring both strategic vision and technical depth to establish AI Quality processes from 0 to 1. Key duties include designing the unified AI Quality strategy, defining success metrics, and leading the development of adversarial test suites for AI solutions.