This job offer is no longer available
About
We're seeking a Software Engineer II with deep experience building event-driven, distributed, and scalable systems in Python. In this role, you'll design and optimize large-scale data and service pipelines running on AWS, supporting Scribd's content enrichment and metadata systems. You'll work closely with cross-functional teams to design reliable backend services that integrate machine learning models and LLM-based components when needed. This role offers the opportunity to work on cutting-edge generative AI and metadata enrichment problems at a truly global scale. Our backend systems are primarily built in Python, leveraging AWS services such as Lambda, ECS, SQS, and ElastiCache for event-driven and distributed processing. We also use Airflow, Spark, Databricks, Terraform, and Datadog for orchestration, data processing, and observability. Key Responsibilities:
Design and implement event-driven, distributed systems to extract, enrich, and process metadata from large-scale document and media datasets. Build and maintain scalable APIs and backend services for high-throughput content processing. Leverage AWS services (ECS, Lambda, SQS, ElastiCache, CloudWatch) to design and deploy resilient, high-performance systems. Collaborate with cross-functional teams to deliver backend solutions that power ML-driven features. Optimize and refactor existing backend systems for scalability, reliability, and performance. Ensure system health and data integrity through monitoring, observability, and automated testing. Requirements:
5+ years of professional software engineering experience on Python or distributed systems development. Strong proficiency in Python (3+ years). Experience with Scala is a plus. Proven experience designing and building event-driven, distributed, and scalable systems. Hands-on experience with AWS services (ECS, Lambda, SQS, SNS, CloudWatch, etc.). Experience with infrastructure-as-code tools like Terraform. Solid understanding of system performance, profiling, and optimization. Bachelor's degree in Computer Science or equivalent professional experience. Bonus: Familiarity with data processing frameworks (Spark, Databricks) and workflow orchestration tools. Bonus: Experience integrating ML or LLM-based models into production systems. At Scribd, your base pay is one part of your total compensation package and is determined within a range. Our pay ranges are based on the local cost of labor benchmarks for each specific role, level, and geographic location. San Francisco is our highest geographic market in the United States. In the state of California, the reasonably expected salary range is between $126,000 to $196,000. In the United States, outside of California, the reasonably expected salary range is between $103,500 to $186,500. In Canada, the reasonably expected salary range is between $131,500 CAD to $174,500 CAD. We carefully consider a wide range of factors when determining compensation, including but not limited to experience; job-related skill sets; relevant education or training; and other business and organizational needs. The salary range listed is for the level at which this job has been scoped. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for a competitive equity ownership, and a comprehensive and generous benefits package. Working at Scribd, Inc.
Are you currently based in a location where Scribd is able to employ you? Employees must have their primary residence in or near one of the following cities. This includes surrounding metro areas or locations within a typical commuting distance: United States: Atlanta | Austin | Boston | Dallas | Denver | Chicago | Houston | Jacksonville | Los Angeles | Miami | New York City | Phoenix | Portland | Sacramento | Salt Lake City | San Diego | San Francisco | Seattle | Washington D.C. Canada: Ottawa | Toronto | Vancouver Mexico: Mexico City Benefits, Perks, and Wellbeing at Scribd: *Benefits/perks listed may vary depending on the nature of your employment with Scribd and the geographical location where you work. Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees 12 weeks paid parental leave Short-term/long-term disability plans 401k/RSP matching Onboarding stipend for home office peripherals + accessories Learning & Development allowance Learning & Development programs Quarterly stipend for Wellness, WiFi, etc. Mental Health support & resources Free subscription to the Scribd Inc. suite of products Referral Bonuses Book Benefit Sabbaticals Company-wide events Team engagement budgets Vacation & Personal Days Paid Holidays (+ winter break) Flexible Sick Time Volunteer Day Company-wide Employee Resource Groups and programs that foster an inclusive and diverse workplace. Access to AI Tools: We provide free access to best-in-class AI tools, empowering you to boost productivity, streamline workflows, and accelerate bold innovation. We want our interview process to be accessible to everyone. You can inform us of any reasonable adjustments we can make to better accommodate your needs by emailing accommodations@scribd.com about the need for adjustments at any point in the interview process. Scribd is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful.
Nice-to-have skills
- Distributed Systems
- Python
- Spark
- Terraform
- Databricks
Work experience
- Backend
- Data Engineer
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.