Senior QA Analyst

About the Role:

Tubi is seeking a highly skilled and experienced Senior QA Analyst to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms.

We're looking for a candidate with a strong background in streaming QA and deep technical knowledge of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality.

This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days/week.

What You'll Do:

• Design and lead test strategies for streaming workflows, playback systems, and AI-powered features.
• Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability.
• Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real-world conditions.
• Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy.
• Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection.
• Contribute to automation and CI/CD frameworks, driving faster, more reliable releases.
• Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches.
• Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly.
• Continuously improve QA processes, metrics, and reporting for streaming and AI validation.

Your Background:

• Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experience
• 4 years of QA experience, preferably in streaming media or VOD/OTT platforms
• Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG-TS), DRM systems, and CDN architectures
• Experience validating AI/ML systems in production — e.g., testing model output accuracy, user personalization logic, and algorithm stability
• Hands-on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI-based visual testing
• Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome DevTools)
• Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms
• Familiarity with Python, Typescript or JavaScript for scripting and test automation
• Understanding of data validation, logging pipelines, and A/B testing frameworks
• Strong analytical and documentation skills, with a proactive approach to cross-team collaboration

Nice to have:

• Experience testing machine learning-driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging
• Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis)
• Familiarity with continuous testing and CI/CD environments (Jenkins, GitHub Actions, CircleCI)
• Understanding of observability tools (Grafana, Kibana, Datadog) for post-deployment validation
• Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes

#LI-CL1