About
Why MWS
Shape quality standards for an entirely new category of legal AI solutions — from the ground up
Work with frontier AI tools to build and run tests faster than traditional QA methods allow
High‑visibility role reporting to Director of QA with direct impact on every solution the team ships
Remote‑first, technically rigorous team that takes production quality seriously
What You’ll Do
Own the full QA lifecycle for AI‑powered solutions — from unit and integration testing through system, performance, and scalability testing
Partner with Analysts to generate and evaluate test cases using AI‑assisted tools, with particular focus on boundary conditions, edge cases, and AI output validation
Work with the engineering team to define and integrate automated test suites into the Azure DevOps CI/CD pipeline for each solution
Define system‑level test strategies in collaboration with the Director of QA, covering functional, regression, and non‑functional testing requirements
Coordinate with the dedicated security team to translate security testing guidance into solution‑specific security test cases
Evaluate AI solution reliability across varied inputs — ensuring consistent, predictable behavior under real‑world conditions
Maintain test documentation, defect tracking, and quality metrics that give leadership clear visibility into solution readiness
Champion a quality culture across the delivery team — making testing a natural part of the development workflow, not a gate at the end
What You Bring
4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle
Strong experience with unit, integration, system, and regression testing — both manual and automated
Hands‑on experience integrating test suites into CI/CD pipelines; Azure DevOps experience strongly preferred
Demonstrated ability to design boundary and edge‑case tests for complex, data‑driven applications
AI fluency — you use AI tools actively and can direct leading AI platforms to generate, evaluate, and refine test cases
Understanding of performance and scalability testing concepts; experience with load testing tools a plus
Solid grasp of defect tracking, test documentation, and quality metrics reporting
Strong analytical thinking — you approach untested AI behavior the way an engineer approaches an unknown system
BS in Computer Science, Information Systems, Engineering, or equivalent experience
Preferred
Experience testing AI‑powered applications — prompt‑driven systems, agentic workflows, or LLM‑integrated tools
Familiarity with AI‑assisted test generation workflows and code‑generating platforms
Exposure to security testing principles in collaboration with a dedicated security team
Experience in legal, financial services, or other regulated industry environments
Knowledge of Azure DevOps, including pipeline configuration and automated test integration
Successful candidates will be provided with outstanding career opportunities and will receive a competitive total rewards package with the opportunity to earn performance‑based bonuses.
Target Hiring Range $93,000 - $142,000 Base pay is based on market location and may vary depending on job‑related knowledge, skills, experience, and geographic location. Base pay is only one part of the Total Rewards that MWS provides to compensate and recognize our staff professionals for their work. Full‑time positions are eligible for a discretionary bonus and a comprehensive benefits package.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Physical Demands And Work Environment Physical Demands
While performing the duties of this job, the employee is required to sit, use hands, reach with hands and arms, stoop, talk and hear
Employee must occasionally lift up to twenty (20) pounds
Work Environment Typical indoor office environment
Disclaimer The above statements are intended to describe the general nature and level of the work being performed by people within this classification. They are not intended to be an exhaustive list of all responsibilities, duties and skills required of employees assigned to this job.
#J-18808-Ljbffr
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.