Senior QA Engineer at Absorb Software
Ontario, Ontario, Canada -
Full Time


Start Date

Immediate

Expiry Date

17 Nov, 26

Salary

0.0

Posted On

19 Aug, 26

Experience

0 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Industry

Software Development & Publishing

Description
  • Review requirements specifications and technical design documents to provide timely and meaningful feedback.
  • Create detailed, comprehensive, and well-structured test plans and test cases and analyze and update existing test cases.
  • Lead and assist more junior QA Analysts.
  • Estimate, prioritize, plan and coordinate testing activities.
  • Design, develop and execute automation scripts using open-source tools, TypeScript, Playwright, or similar automation frameworks (e.g., Cypress, Selenium).
  • Use AI coding assistants and agentic tools, such as Claude Code, to accelerate test authoring, maintain automation scripts, and triage defects.
  • Build, customize, and maintain reusable AI skills and agentic workflows that streamline repeatable QA tasks (test generation, regression checks, defect documentation).
  • Apply spec-driven development practices, for example the AI-Driven Development Lifecycle (AI-DLC), to translate requirements into structured specifications that guide AI-assisted test generation and validation.
  • Design and run evaluations ("evals") for AI-powered features to measure accuracy, relevance, hallucination rate, and other quality metrics against defined test datasets.
  • Apply non-deterministic testing approaches for AI/LLM-based features, using statistical thresholds, sampling, and repeated-run analysis rather than fixed pass/fail assertions.
  • Configure and monitor AI observability and evaluation tooling (e.g., Arize AX/Phoenix, LangSmith, or similar) to track model/agent performance, detect drift, and flag regressions in production.
  • Identify, record, document, track, and close bugs.
  • Perform thorough regression testing when bugs are resolved.
  • Actively transfer knowledge to other QA Team members via documentation and QA presentations, including AI-assisted testing practices and tooling.
  • Ad hoc duties as required.

What you'll bring:

  • Proven experience in manual and automated QA testing of web applications.
  • Proficiency in TypeScript/JavaScript with hands-on experience in Playwright or a comparable automation framework (Cypress, Selenium, WebdriverIO).
  • Practical experience using AI coding assistants and agentic tools (e.g., Claude Code, GitHub Copilot) for writing, maintaining, or reviewing test automation.
  • Working understanding of spec-driven development methodologies (e.g., AI-DLC / AI-Driven Development Lifecycle) and how structured specifications drive AI-assisted planning, execution, and validation.
  • Ability to build and maintain custom AI skills, prompts, or agent workflows to streamline QA processes.
  • Understanding of non-deterministic testing: recognizing that AI/LLM outputs vary between runs and require different validation strategies than deterministic UI/API testing.
  • Experience designing evaluation ("eval") datasets and metrics (accuracy, relevance, hallucination, toxicity, latency) for AI-powered features.
  • Familiarity with AI observability and evaluation-monitoring platforms such as Arize (AX/Phoenix), LangSmith, or Braintrust for tracking model/agent quality in production.
  • Solid grounding in QA methodologies, the SDLC, and test planning/estimation.
  • Strong analytical, written, and verbal communication skills, with the ability to mentor junior QA Analysts.

Educational requirements:

  • Bachelor's Degree in a Technical field and 5+ years of experience, or equivalent job experience.

Are you ready to become an Absorber?

What we offer:

  • Fully remote-first work with flexible work arrangements 🏡
  • Comprehensive Health and Wellness Benefits including retirement savings programs, eligibility for two different bonus plans, generous time off, comprehensive medical and dental benefits based on your country of location 🧘
  • New Hire Equipment Allowance and monthly Flex Allowance to support your success 📦
  • Endless opportunity for career growth and internal mobility 🌱
  • Employee driven DE&I programs 🫶
  • Who are we?

How To Apply:

Incase you would like to apply to this job directly from the source, please click here

Responsibilities
Loading...