AI Q&A Engineer

We need a QA engineer who can test both traditional SaaS systems and AI-specific behaviour — non-deterministic outputs, model regressions, conversational quality.

Responsibilities
Automated test frameworks across UI, API, and end-to-end workflows
AI eval pipelines: intent accuracy, response quality, fallback handling
QA strategy covering regression, performance, and exploratory testing
Embed quality into CI/CD; track metrics and drive improvement
Partner with product and engineering to catch issues early
Requirements
5+ years QA, including 2+ in SaaS
Hands-on experience testing AI or LLM-based products
Test automation — Playwright, Cypress, Selenium, or similar
API testing — Postman, RESTAssured, or similar
CI/CD integration — GitHub Actions, Jenkins, or similar
Python, JavaScript, or equivalent
Nice to have
k6 / JMeter
AWS / GCP / Azure
Docker / Kubernetes
Speech / ASR testing
ISTQB
Applications reviewed on a rolling basis