AI/ML Engineer - Test Automation | RAG | Self-Healing | LLM at CodeNinja

Islamabad, Islamabad Capital Territory, Pakistan -

Full Time

Start Date

Immediate

Expiry Date

03 Aug, 26

Salary

0.0

Posted On

05 May, 26

Experience

5 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

Skills

RAG Pipelines, LLMs, Python, Vector Databases, Self-healing Automation, AI Governance, ML Engineering, Test Automation, Defect Clustering, Root Cause Analysis, Risk-based Regression, Explainable AI, Pinecone, Weaviate, ChromaDB, Embedding Models

Industry

Software Development

Description

About CodeNinja CodeNinja is a next-generation technology consulting firm specialising in AI-powered transformation, enterprise software delivery, and Quality Engineering. Headquartered in the Gulf region and operating across the MENA, South Asia, and global markets, CodeNinja partners with Tier-1 banks, government entities, and large enterprises to design, build, and run mission-critical technology programs. With deep expertise in QA transformation, test automation, DevOps modernisation, and AI/ML engineering, CodeNinja's teams combine global delivery standards with in-market contextual knowledge — ensuring outcomes that are compliant, scalable, and commercially aligned with client objectives. For the Client's Test Management Enablement & Automation engagement, CodeNinja brings a dedicated 12-person specialist team spanning Test Management, Automation Engineering, AI/ML, and Performance Testing — all governed under a structured 20-week program delivery framework. About the Role The AI/ML Engineer builds the RAG pipeline for BRD-to-test-plan generation, develops self-healing locator models, implements risk-based regression optimisation, and operates within the client's AI governance framework. This is a pioneering role at the cutting edge of intelligent test automation. Key Responsibilities • Design and build the Retrieval-Augmented Generation (RAG) pipeline to analyse BRD documents and generate test plans and test designs. • Develop self-healing element identification models for UI automation, targeting >85% recovery rate. • Implement risk-based regression optimisation algorithms to prioritise test execution by change impact. • Build defect clustering and root cause pattern recognition capabilities. • Ensure all AI models operate within the client's AI governance framework: PII-free training data, synthetic data only, human-in-the-loop validation. • Version-control all AI models with rollback capability and maintain comprehensive audit trails. • Produce explainable AI outputs with confidence scores and reasoning traceability. • Collaborate with the client's CISD and AI governance teams on model approvals and compute/GPU access. • 6+ years of ML/AI engineering experience, with at least 2 years applying AI to software testing or QA. • Strong experience building RAG pipelines with LLMs (GPT-4, Claude, Llama, or equivalent). • Proficiency in Python, vector databases (Pinecone, Weaviate, or ChromaDB), and embedding models. • Experience with self-healing test automation concepts and dynamic element locators. • Understanding of AI governance, explainability, and bias detection in enterprise contexts. • Experience working within bank-hosted or air-gapped AI environments. • Preferred Certifications: Google Cloud ML Engineer, Azure AI Engineer Associate, AWS ML Specialty (bonus). Why Join CodeNinja? • Work on high-impact, flagship banking transformation programs with a Tier-1 Saudi financial institution. • Be part of a team that's shaping the future of AI-enabled test automation in the MENA region. • Collaborate with world-class QA professionals across onsite and offsite delivery models. • Access to continuous upskilling — certifications, AI/ML tooling, and emerging QA methodologies. • Competitive compensation with performance-linked incentives and career progression pathways. • A culture that values technical excellence, ownership, and innovation without bureaucracy. Disclaimer This job description outlines the primary responsibilities and qualifications for the role at the time of posting. It is not exhaustive and may evolve in line with business needs and project requirements. CodeNinja reserves the right to modify role scope as the engagement progresses. All candidates will be subject to standard background verification. Onsite positions require compliance with the client's site access, security, and NDA policies. CodeNinja is an equal opportunity employer and welcomes applications from all qualified individuals regardless of background.

Responsibilities

Design and implement RAG pipelines for test plan generation and develop self-healing models for UI automation. Ensure all AI models adhere to strict governance frameworks and provide explainable outputs with traceability.