About the job

Company Description Cranium AI is dedicated to securing the AI revolution through its award-winning AI Security and AI Governance platform, enabling organizations of all sizes to safely adopt and scale AI across their entire AI supply chain. The platform helps identify, manage, and mitigate AI-related risks, supporting security, compliance, and responsible innovation. Headquartered in the New York metropolitan area, Cranium AI focuses on making AI safe and trustworthy for everyone. Team members, known as “Craniacs,” work together to redefine standards for AI excellence and value realization, in a dynamic, impact-driven environment.

About the Role

Location: New Jersey

Quality Engineers at Cranium test and build solutions to maintain our compliance and security toolset — the platform securing the AI revolution. You'll work across our full stack: Python-based AI science services that integrate with large language models, .NET backend APIs that orchestrate security workflows, and React/TypeScript frontends that put powerful tools in our users' hands.

This is a hands-on, embedded role. You're an engineer first, not just a “tester” — you'll sit on engineering teams, contribute directly to feature delivery, and be in the codebase building the tooling that keeps quality high as we move fast.

What You'll Do

•       Embed on engineering teams and support full-stack feature delivery from planning through release

•       Validate AI-powered features including LLM-based compliance scoring, vulnerability assessment, and code analysis services

•       Build and maintain automated tests across our platform — API integration tests, end-to-end browser tests — and work closely with developers to increase unit test coverage, maintaining fast feedback loops and test stability

•       Identify gaps in our automated test strategy and propose practical solutions

•       Triage and investigate defects, driving them to resolution

•       Communicate risks clearly to the team — surface what matters, when it matters

What You Bring

Required:

•       Experience building automated test suites in a production environment

•       Proficiency in one or more of: TypeScript, .NET/C#, or Python (you don't need all three, but you'll encounter all three)

•       Experience with Playwright or similar browser automation frameworks

•       Ability to work across the stack — you have experience working and testing across frontend components and backend APIs

•       Clear communication skills — you can articulate what's broken, what's risky, and what matters

Strongly Valued:

•       Experience testing AI/ML systems — LLM outputs, prompt-based workflows, non-deterministic results

•       Experience leveraging AI tools to accelerate your own testing and development workflows

•       Familiarity with test tooling such as Vitest, xUnit/NUnit, pytest, k6 or Artillery (performance), Postman/REST client tools, or contract testing frameworks

•       Experience testing event-driven architectures — message queues, async processors, eventual consistency

•       Experience with API testing across RESTful services

•       Familiarity with CI/CD pipelines and integrating test suites into automated deployment workflows

Our Quality Philosophy

Quality Engineering at Cranium is driven by whole-team ownership of quality. Quality Engineers provide the tools, insight, and support that enable every engineer to deliver with confidence. They bring a diverse skillset, deep knowledge of software development, a passion for delivering high-quality software to our users, and clear communication skills to surface issues and risks before they reach production.

We're not a QA gate. We're building a quality culture — and Quality Engineers play a pivotal role in designing quality into our systems from the start.

… more