Senior Machine Learning QA Engineer

Autodesk

Montreal, Québec, Canada

Montreal, Québec, Canada

Jetzt Bewerben

Über

Position Overview As a Senior ML QA Engineer in the Research Enablement team, you will work side-by-side with researchers, ML engineers, and software engineers to define and uphold quality standards for ML systems. You are a quality-focused engineer who is passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps, with a strong software engineering base. You are excited to collaborate across research and product to ship ML capabilities with clear quality gates. You are comfortable working at the intersection of research and product and are competent in using Autodesk CAD software. Reporting Structure: You will report to an Engineering Manager in Research Enablement. Location: Toronto, Canada (Hybrid). We are a global team, located in London, San Francisco, Toronto, and remotely. Autodesk is a hybrid-first company, allowing workers to work remotely, in an office, or a mix of both. Responsibilities Define ML quality strategy and acceptance criteria across data, model, and system levels Design and maintain model evaluation suites, metrics, and test datasets Evaluating CAD RL model outputs for geometric validity or policy stability Defining structured rubrics that translate qualitative findings into measurable evaluation gates Testing ML Models from product side API Testing Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins) Create and maintain test harnesses for ML services and APIs Mentor teams on ML QA best practices and consistent evaluation standards Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection) Contribute to multi-team projects and codebases, ensuring code quality and consistency Participate in code reviews and provide constructive feedback to peers Document and present findings and ideas across the company Minimum Qualifications Bachelor’s degree in Computer Science, Engineering, or equivalent experience 7+ years of professional experience in software engineering or QA for ML/AI systems Strong programming skills in Python, with experience in test automation Familiarity with popular CAD environments tooling Proficient in Automation and UAT test suite/framework Experience designing QA frameworks or platforms used by multiple teams Excellent problem-solving skills and attention to detail Strong communication and collaboration skills Understanding of software architecture and design patterns Ability to work in an agile development environment Preferred Qualifications Experience with data validation tooling (e.g., Great Expectations) or labeling workflows Familiarity with ML frameworks (e.g., PyTorch, TensorFlow) Experience with CI/CD tools and processes Experience with data pipelines and orchestration tools (e.g., Airflow, Metaflow) Familiarity with MLOps practices (model monitoring, drift, deployment checks) Experience with ML evaluation methods, metrics, and benchmarking Passion for learning new technologies and improving existing systems Experience with cloud providers (e.g., AWS, Azure, Google Cloud Platform) Experience testing ML services in production environments Knowledge of experiment tracking tools (e.g., Comet, MLflow, Weights elle est au cœur de tout ce que nous faisons. Notre culture guide notre façon de travailler et de nous comporter les uns envers les autres, influence nos interactions avec nos clients et nos partenaires, et définit notre image au monde. En tant qu’Autodeskien, vous pouvez accomplir un travail significatif qui contribue à bâtir un monde meilleur, conçu et réalisé pour tous. Prêt à façonner le monde et votre avenir ? Rejoignez-nous ! Salary transparency / Transparence salariale Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package. Le salaire est l'un des éléments du programme de rémunération concurrentiel d'Autodesk. Pour les postes basés au Canada (Colombie-Britannique), nous proposons un salaire de base compris entre X et X dollars. Les offres sont basées sur l'expérience et la situation géographique du candidat et peuvent dépasser cette fourchette. En plus du salaire de base, notre programme de rémunération peut inclure des primes annuelles en espèces, des commissions pour les postes commerciaux, des attributions d'actions et un ensemble complet d'avantages sociaux. Diversity

Montreal, Québec, Canada

Sprachkenntnisse

French

Hinweis für Nutzer

Dieses Stellenangebot stammt von einer Partnerplattform von TieTalent. Klicken Sie auf „Jetzt Bewerben“, um Ihre Bewerbung direkt auf deren Website einzureichen.

Jetzt Bewerben