Senior Quality Assurance Engineer - REMOTE at Jobgether

, , New Zealand -

Full Time

Start Date

Immediate

Expiry Date

23 May, 26

Salary

0.0

Posted On

22 Feb, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

Playwright, TypeScript, Python, Automated Testing, AI Agents, LLM Pipelines, RAG Pipelines, CI/CD, Guardrails, Prompt Drift, Hallucinations, Edge Cases, Multi-step Reasoning, Systems Thinking, JavaScript

Industry

Internet Marketplace Platforms

Description

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Senior QA Tester - REMOTE. In this role, you will take charge of leading our automated testing efforts, focusing on innovative AI features and non-deterministic systems. Your expertise will significantly contribute to improving the quality of our AI agents and LLM pipelines. You will collaborate closely with AI researchers and developers to define quality metrics and ensure robust testing strategies. This is a pivotal role that not only enhances product quality but also shapes the future of enterprise automation. \n Accountabilities Own the E2E framework: Build, maintain, and scale our automated testing framework using Playwright (TypeScript/Python). Test the unpredictable: Design strategies to test non-deterministic LLM outputs, AI agents, and RAG pipelines. Tackle LLM-specific challenges: Build guardrails and automated checks for prompt drift and hallucinations. Evaluate Agent behavior: Create scenarios to test how AI agents handle edge cases and multi-step reasoning. Integrate and collaborate: Wire tests into our CI/CD pipelines, ensuring consistency with AI logic. Requirements 5+ years in QA Automation or Software Engineering in Test (SDET). Deep, hands-on experience with Playwright for reliable test suite development. Strong programming skills in TypeScript, JavaScript, or Python. Understanding of LLMs and their testing challenges. Systems thinking for analyzing complex architectures. Excellent communication skills to explain QA issues clearly. Benefits Freedom and ownership of impactful work. Positive organizational culture focused on personal and professional growth. Commitment to diversity and inclusion. Top market compensation package including company shares. Personal development budget, meal allowance, and recreational activities. \n Why Apply Through Jobgether? We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1

Responsibilities

The role involves leading automated testing efforts, focusing on innovative AI features and non-deterministic systems to improve the quality of AI agents and LLM pipelines. Responsibilities include owning and scaling the E2E testing framework, designing strategies for non-deterministic outputs, and building checks for LLM-specific challenges like prompt drift.