QA Engineer, AI

QA Engineer, AI WHO WE'RE LOOKING FOR: THE ONE THING THAT MATTERS You are the last line of defence between our code and patient care. TORTUS runs in hospitals, GP surgeries, ambulances, and across dozens of clinical environments — on iPads, in Epic, Cerner, Surgery Connect, EMIS, and multiple browsers. You'll own quality end-to-end: building the automated test infrastructure, running AI output evaluations, managing releases, and ensuring nothing ships that could break in any of those places. You'll be managing AI coding agents, building simulation suites for clinical AI outputs, and pioneering what quality engineering looks like when development is AI-accelerated. We’re looking for a technically strong QA engineer who is obsessed with AI tooling. You'll be building and maintaining automated test suites, but you'll also be running multiple coding agent instances, designing Playwright harnesses at scale, and creating entirely new kinds of tests — like evaluating whether our AI-generated clinical notes are correct. You'll also need to be comfortable rolling up your sleeves for hands-on manual and exploratory testing — complex clinical workflows across multiple deployment surfaces demand human judgement, not just automation. If you're the kind of person who sees AI agents as force multipliers rather than novelties, we want to talk to you. WHAT ELSE WOULD BE GREAT - 2–5 years of experience in QA engineering, software testing, or SDET roles - Hands-on experience with automated testing frameworks (Playwright, Jest, Vitest, or similar) - Genuine enthusiasm for AI-assisted development — you're already using Claude Code, Cursor, Codex, or similar tools to ship faster - Familiarity with CI/CD pipelines and integrating quality gates into automated workflows - Understanding of requirements traceability and how to maintain requirement to test case mapping - Experience writing test plans, protocols, and verification reports - Comfort testing across multiple platforms and environments (web, mobile, iPad, embedded in third-party systems) - Exposure to compliance standards (IEC 62304, ISO 13485, ISO 14971) or Quality Management Systems is a strong plus — but not required - Strong written communication — you'll be producing documentation that goes into our regulatory technical file WHAT YOU'LL DO AUTOMATED TESTING & INFRASTRUCTURE - Own and expand the end-to-end test suite using Playwright, Jest, and Vitest — covering unit, integration, system, and E2E testing - Build automated test harnesses for all deployment surfaces: web app, iPad, Epic, Cerner, Surgery Connect, EMIS, and multiple browsers - Design test cases covering functional requirements, edge cases, and failure modes - Integrate tests into CI pipelines to gate every PR with passing tests - Use AI coding agents to accelerate test creation and maintenance AI OUTPUT EVALUATION & SIMULATION - Build end-to-end simulation suites for our clinical AI pipeline: upload known audio, verify transcripts, clinical codes, and guidelines are correct - Create smoke tests for AI outputs - Collaborate with the ML team on AI evaluations — both deterministic tests and non-deterministic model output evaluations - Detect quality regressions when prompts, models, or pipelines change RELEASE MANAGEMENT & QA GATING - Own the QA process for versioned releases - Run regression and manual exploratory testing across all supported environments before promoting to production - Manage the release checklist — ensure nothing ships without verification on all target platforms TRACEABILITY & COMPLIANCE - Maintain the requirements traceability matrix, linking software requirements to test cases and results - Ensure verification coverage with documented evidence for our regulatory technical file - Support ISO 13485 audits and Class IIa certification with testing evidence - Automate compliance workflows where possible DEFECT MANAGEMENT - Log, triage, and track defects with clear severity c ... (truncated, view full listing at source)