AI QA Testing Engineer at Premier NX

Lahore, Punjab, Pakistan -

Full Time

Start Date

Immediate

Expiry Date

25 Sep, 26

Salary

0.0

Posted On

27 Jun, 26

Experience

2 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

AI QA Testing, Conversational AI, Scenario-based Testing, Intent Recognition, IVR Testing, Test Planning, Analytical Skills, Communication Skills, Prompt Design, NLP, Python, Postman, API Testing, CCaaS, Quality Documentation, User Experience Evaluation

Industry

Outsourcing and Offshoring Consulting

Description

About the Role: Were looking for a skilled and detail-oriented AI Agent Testing Specialist to help ensure the quality and performance of our AI-driven voice and conversational agents. This role goes beyond traditional software testing — youll be evaluating how AI behaves, responds, and performs in real-world call scenarios across our communication platforms. If you enjoy testing interactive systems, analyzing conversational flows, and helping shape how intelligent virtual agents interact with customers, this role is for you. Key Responsibilities: Design and execute scenario-based test cases to evaluate AI agent behavior, accuracy, and naturalness in simulated call environments. Test AI call flows, intent recognition, response accuracy, and escalation handling. Identify and document behavioral issues, misclassifications, or poor user experiences. Collaborate with developers, AI trainers, and QA teams to refine conversational logic and performance. Analyze call logs, transcripts, and AI decision paths to suggest improvements. Support the fine-tuning and validation of AI responses based on training data and feedback. Contribute to continuous test automation and test plan improvements. Required Skills & Experience: 2+ years of experience in software or QA testing, preferably with AI, IVR, or contact center solutions (CCaaS, Amazon Connect, Twilio, 3CX, etc.) Familiarity with conversational AI systems (ChatGPT, Dialogflow, Lex, or similar). Understanding of test planning, scenario testing, and quality documentation. Strong analytical and communication skills. Ability to think from the end-user perspective and evaluate how interactions feel. Comfortable working in collaborative, cross-functional environments. Preferred Experience: Experience with AI prompt design or conversational flow building. Background in speech recognition, NLP, or voice application testing. Exposure to Python, Postman, or API testing tools. Training & Support: We provide hands-on training on our specific AI testing platform, tools, and process. Candidates with a strong QA foundation and a willingness to learn are highly encouraged to apply. What we offer: Market-competitive salary Career growth opportunities Learning & development programs On-the-job training Medical Coverage (IPD) Life Insurance Paid Leaves (Annual, Casual, Sick, Marriage, Maternity, Paternity, Hajj, Bereavement) Provident Fund Employee Old Age Benefits (EOBI) Employee engagement & wellness initiatives

Responsibilities

Design and execute scenario-based test cases to evaluate the behavior, accuracy, and naturalness of AI-driven voice and conversational agents. Collaborate with developers and AI trainers to refine conversational logic and analyze call logs for performance improvements.