Software Engineer - Quality at Southwest Airlines

, , India -

Full Time

Start Date

Immediate

Expiry Date

17 Aug, 26

Salary

0.0

Posted On

19 May, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Python, TypeScript, JavaScript, LLM Evaluation, Agentic AI Testing, CI/CD, Playwright, Pytest, Distributed Systems Testing, Chaos Engineering, AWS, MLOps, Load Testing, Observability, Agile, Software Quality Assurance

Industry

Airlines and Aviation

Description

Department: Technology Our Company Promise We are committed to provide our Employees a stable work environment with equal opportunity for learning and personal growth. Creativity and innovation are encouraged for improving the effectiveness of Southwest Airlines. Above all, Employees will be provided the same concern, respect, and caring attitude within the organization that they are expected to share externally with every Southwest Customer. Job Description: As a Software Engineer Global supporting Quality within Southwest’s Agentic AI initiatives, you’ll help ensure AI‑driven systems are reliable, accurate, and production‑ready. This role blends core software engineering with modern quality practices—building testable services, validating complex workflows, and supporting automation that prevents issues before they reach production. You’ll work closely with Engineers, Platform Teams, and Operations Partners to embed quality throughout the development lifecycle, applying strong testing, observability, and CI/CD practices. This role offers hands‑on experience shaping the quality standards for AI systems that operate at scale. As we continue to grow our Global Innovation Center (GIC) in Hyderabad, we’re hiring multiple Software Engineers supporting Quality across a variety of Pods and initiatives—each offering the opportunity to lead meaningful work, navigate complexity, and help advance the technology that powers Southwest’s operation. Read on to learn more about the Pods you could support. Agentic AI - Customer & Commercial Pod In the Agentic AI – Customer & Commercial Pod, you’ll support quality assurance for AI experiences that help Customers get help, explore options, and complete transactions through natural, intuitive interactions. This role focuses on executing end‑to‑end testing strategies for agentic AI solutions, including multi‑agent workflows running in production environments. You’ll help build and maintain QA automation frameworks, create reusable test assets, and drive macro‑level validation across complex agentic flows. You’ll validate resiliency, reliability, accuracy, latency, orchestration correctness, and scale—helping ensure Customer‑facing AI experiences behave predictably and meet high quality standards from development through production. Agentic AI - ETO Support Pod In the Agentic AI – ETO Support Pod, you’ll help define and implement how the organization tests non‑deterministic, LLM‑driven systems that support enterprise and back‑office workflows. This role combines classic test automation with emerging AI evaluation techniques—using tools such as Playwright or pytest alongside LLM evaluation frameworks to validate behavior, safety, and regression over time. You’ll work shoulder‑to‑shoulder with AI Engineers to design quality gates, guardrails, and evaluation harnesses that directly influence what ships to production. Your contributions help establish practical, scalable quality practices for agentic systems that must operate reliably across internal technology platforms. Responsibilities Apply knowledge and skills of software development and testing effectively to solve a range of problems Work alongside other engineers on the team to elevate technology and consistently apply best practices Collaborate closely with customers and cross-functional departments to communicate project statuses and proposals Document each aspect of a system or application as a reference for future upgrades and maintenance Determine and assess the needs of the user and then create software to meet the requirements Identify and resolve issues that arise during the design, testing and maintenance processes using problem-solving skills Work in an agile environment to deliver high-quality software Prepare and install solutions by determining and designing system specifications, standards, and programming Mentor junior members on the team Improve and expand technical capabilities by continuing their education thru reading, workshops, conferences, and/or communities of practice May perform other job duties as directed by Employee's Leaders Knowledge, Skills and Abilities Intermediate knowledge of software development methodologies, practices, concepts, and technologies obtained through formal training and / or work experience Ability to demonstrate consistent knowledge application, skills of software development, and testing to solve a range of problems Intermediate knowledge of at least one required programming language Ability to partner, communicate, and negotiate with various Technology or partner Teams Ability to analyze and manage large, complex, and vague Business or technical problems, articulating the problem or root cause, and translating the analysis into viable solution recommendations Ability to take on multiple assignments, whether administrative or project related, while maintaining a successful level of completion in all responsible work Ability to mentor others to do the same Ability to develop, present and effectively communicate ideas and strategies to a variety of audiences Education Required: Bachelor's degree in Computer Science, Engineering, Information Systems or related field and/or equivalent formal training Experience Required: Intermediate-level experience, fully functioning broad knowledge in Software engineering 2-5 years of relevant work-related experience 3+ years in Software QA/Testing, with 1+ years in AI/ML or LLM-based systems; hands-on experience testing agentic/multi-agent architectures Strong programming skills in Python or TypeScript/JavaScript; experience building test harnesses, simulators, and fixtures. Experience with LLM evaluation (exact/soft match, BLEU/ROUGE, BERTScore, semantic similarity via embeddings), guardrails, and prompt testing. Agentic AI performance/ Load testing experience and Agentic AI defect life cycle and defect triage experience Expertise in distributed systems testing, latency profiling, resiliency patterns (circuit breakers, retries), chaos engineering, and message queues. Preferred: Experience in Prior ownership of cost/latency/SLAs for AI workloads in production. Knowledge of MLOps (model versioning, datasets, evaluation pipelines) and A/B experimentation for LLMs. Background in cloud (AWS), serverless, containerization, and event-driven architectures. Multi-agent simulators, agent graph testing, and tooling latency emulation Building test harnesses, simulators, and fixtures Other Qualifications Must meet confidentiality expectations as to confidential, proprietary and sensitive Company information Ability to work extended hours as needed Southwest Airlines is an Equal Opportunity Employer. Please print/save this job description because it won't be available after you apply.

Responsibilities

Ensure the reliability and accuracy of AI-driven systems by building testable services and validating complex agentic workflows. Collaborate with cross-functional teams to embed quality standards and observability throughout the development lifecycle.