Über
Job Title AI QA Engineer
What You'll Do
Design and implement comprehensive test frameworks for AI/ML systems: LLMs, vision models, RAG pipelines, agentic workflows
Create quality benchmarks and continuous testing pipelines for generative AI (content quality, safety, brand alignment)
Develop performance monitoring infrastructure: model drift detection, data quality validation, inference latency tracking
Establish AI‑specific quality gates and work with product/engineering teams in Agile sprints to define acceptance criteria
Stay ahead of AI testing trends: adversarial testing, red‑teaming, AI safety evaluation
Basic Qualifications
3+ years in QA/test engineering with a focus on AI/ML systems
Deep understanding of ML model evaluation: classification metrics, NLP evaluation (BLEU, ROUGE, human eval), vision model testing
Experience building test automation frameworks (Python, pytest, CI/CD pipelines)
Preferred Qualifications
Knowledge of AI risks: bias, fairness, safety, hallucinations, adversarial attacks
Strong collaboration skills; comfortable working with data scientists, ML engineers, and product managers
Passion for AI quality and staying current with testing methodologies for generative AI
We are hiring for multiple roles at various levels.
Compensation Base salary range: $110,000‑$150,000. Individuals may also be considered for bonus and/or commission.
EEO Statement We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, religion, sexual orientation, gender identity, national origin, status as a veteran, and basis of disability or any federal, state, or local protected class.
#J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klick auf „Jetzt Bewerben”, um deine Bewerbung direkt auf deren Website einzureichen.