Dieses Stellenangebot ist nicht mehr verfügbar
Über
* Opportunity mapping. Size and prioritize new recs surfaces, intents, and cohorts; trace the funnel and analyze by slice (cold items, long-tail users, platform) to steer the roadmap. * Own the evaluation framework. Define north star & guardrails (e.g. diversity, novelty, duplication, safety); set threshold and tradeoffs, and publish the Objective & Eval Contract per surface. * Offline/Online alignment. Quantify correlation between offline IR metrics (e.g., NDCG@K, MAP, MRR, coverage, calibration) and online KPIs by surface/cohort; publish error bounds and monitor metric drift. * Create leading indicators. Create short-horizon metrics that predict long-term outcomes (e.g., trial to bill-through); backtest and run post-hoc causal checks, reporting uncertainty. * Build the measurement architecture. Set identity & attribution standards (user_id vs. device_id, qualifying events, windows) so downstream metrics (bill-through, churn) are trustworthy. * Design and run advanced experiments such as interleaving tests, pre-register stop/go criteria, and deliver crisp readouts that drive decisions. * Codify schemas, freshness, leakage, and drift checks with Analytics and Data Engineers, establish high quality datasets for Recs algo. * Evaluate when LLMs/embeddings (topics, summaries, semantic similarity) measurably improve offline/online metrics; prototype and hand off clear build specs to ML Eng. * Storytelling and influence. Write decision memos, align cross-functional teams, and drive clear decisions with trade-offs and risks called out.
What you'll need:
* 8+ years experience in Data Science, preferably on recs/search/ranking with shipped impact. * Strong Python and SQL; comfort with Spark. * Fluency in ranking evaluation (NDCG@K, MAP, MRR, calibration, coverage/diversity) and awareness of exposure/selection bias. * Fluency in experiment design and connecting offline metrics to online outcomes. * Ability to translate product goals into loss functions, features, and specs engineers can build.
Nice to have:
* Familiarity with LLMs/embeddings evaluation in offline and online; embeddings/vector search assessment for lift vs. latency/cost
At Scribd, your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role, level, and geographic location. San Francisco is our highest geographic market in the United States. In the state of California, the reasonably expected salary range is between $162,000 to $252,500. In the United States, outside of California, the reasonably expected salary range is between $133,000 to $239,500. In Canada, the reasonably expected salary range is between $169,000 CAD to $224,500 CAD. We carefully consider a wide range of factors when determining compensation, including but not limited to experience; job-related skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership, and a comprehensive and generous benefits package. Working at Scribd Inc. Are you currently based in a location where Scribd Inc. Employees must have their primary residence in or near one of the following cities. This includes surrounding metro areas or locations within a typical commuting distance: United States: Atlanta | Austin | Boston | Dallas | Denver | Chicago | Houston | Jacksonville | Los Angeles | Miami | New York City | Phoenix | Portland | Sacramento | Salt Lake City | San Diego | San Francisco | Seattle | Washington D.C. Canada: Ottawa | Toronto | Vancouver Mexico: Mexico City Benefits, Perks, and Wellbeing at Scribd Inc.
* Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees * 12 weeks paid parental leave * Short-term/long-term disability plans * 401k/RSP matching * Onboarding stipend for home office peripherals + accessories * Learning & Development allowance * Learning & Development programs * Quarterly stipend for Wellness, WiFi, etc. * Mental Health support & resources * Free subscription to the Scribd Inc. suite of products * Referral Bonuses * Book Benefit * Sabbaticals * Company-wide events * Team engagement budgets * Vacation & Personal Days * Paid Holidays (+ winter break) * Flexible Sick Time * Volunteer Day * Company-wide Employee Resource Groups and programs that foster an inclusive and diverse workplace. * Access to AI Tools: We provide free access to best-in-class AI tools, empowering you to boost productivity, streamline workflows, and accelerate bold innovation.
Want to learn more about life at Scribd? www.linkedin.com/company/scribd/life We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing accommodations@scribd.com about the need for adjustments at any point in the interview process. Scribd Inc. is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful. #J-18808-Ljbffr
Sprachkenntnisse
- English
Hinweis für Nutzer
Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.