This job offer is no longer available
Senior Backend Engineer (Python + Distributed systems)
Scribd
- United States
- United States
About
At Scribd (pronounced scribbed), our mission is to spark human curiosity. We create a world of stories and knowledge, democratize the exchange of ideas and information, and empower collective expertise through our four products: Everand, Scribd, Slideshare, and Fable. About The Team
The ML Data Engineering team powers metadata extraction, enrichment, and content understanding across all Scribd brands. We process hundreds of millions of documents, billions of images, and deliver high?quality metadata to enable content discovery and trust for millions of users worldwide. Role Overview
Were seeking a Senior Software Engineer with deep experience building event?driven, distributed, and scalable systems in Python. In this role, youll design and optimize large?scale data and service pipelines running on AWS, supporting Scribds content enrichment and metadata systems. Youll work closely with cross?functional teams to design reliable backend services that integrate machine learning models and LLM?based components when needed. This role offers the opportunity to work on cutting?edge generative AI and metadata enrichment problems at a truly global scale. Tech Stack
Python on AWS (Lambda, ECS, SQS, ElastiCache, CloudWatch), Airflow, Spark, Databricks, Terraform, and Datadog for orchestration, data processing, and observability. Key Responsibilities
Provide technical leadership, mentorship, and guidance to engineers across the organization, driving secure coding best practices. Lead the design, implementation, and scaling of event?driven, distributed systems to extract, enrich, and process metadata from large?scale document and media datasets. Partner with Data Science, Infrastructure, ML Engineering, and Product teams to architect and deliver robust systems that balance scalability, high performance, and rapid iteration. Contribute to the teams engineering strategy, identifying gaps, proposing new initiatives, and improving existing frameworks. Build and maintain scalable APIs and backend services for high?throughput content processing. Leverage AWS services (ECS, Lambda, SQS, ElastiCache, CloudWatch) to design and deploy resilient, high?performance systems. Optimize and refactor existing backend systems for scalability, reliability, and performance. Ensure system health and data integrity through monitoring, observability, and automated testing. Requirements
7+ years of professional software engineering experience with a focus on backend or distributed systems development. Strong proficiency in Python (5+ years). Experience with Scala is a plus. Expertise in designing and architecting large?scale event?driven and distributed systems. Strong cloud expertise with AWS services (ECS, Lambda, SQS, SNS, CloudWatch, etc.). Experience with infrastructure?as?code tools like Terraform. Solid understanding of system performance, profiling, and optimization. Experience leading technical projects and mentoring engineers. Bachelors degree in Computer Science or equivalent professional experience. Bonus: Familiarity with data processing frameworks (Spark, Databricks) and workflow orchestration tools. Bonus: Experience integrating ML or LLM?based models into production systems. Compensation
San Francisco salary range: $146,500 $228,000. Other U.S. markets: $120,000 $217,000. Canada: $153,000 $202,000 CAD. Benefits, Perks, and Wellbeing
Healthcare Insurance Coverage (Medical/Dental/Vision): 100% paid for employees 12 weeks paid parental leave Short?term/long?term disability plans 401k/RSP matching Onboarding stipend for home office peripherals + accessories Learning & Development allowance and programs Quarterly stipend for Wellness, WiFi, etc. Mental Health support & resources Free subscription to the Scribd Inc. suite of products Referral Bonuses Book Benefit Sabbaticals Company?wide events Team engagement budgets Vacation & Personal Days Paid Holidays (+ winter break) Flexible Sick Time Volunteer Day Company?wide Employee Resource Groups and programs that foster an inclusive and diverse workplace. Access to AI Tools: We provide free access to best?in?class AI tools, empowering you to boost productivity, streamline workflows, and accelerate bold innovation. Equal Employment Opportunity Statement
Scribd is committed to equal employment opportunity regardless of race, color, religion, national origin, gender, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law. We encourage people of all backgrounds to apply, and believe that a diversity of perspectives and experiences create a foundation for the best ideas. Come join us in building something meaningful. #J-18808-Ljbffr
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.