Software Engineer - Backend (Python)
Core
Design and optimize large-scale data and service pipelines for metadata extraction, enrichment, and content understanding across Scribd's document and media datasets.
Role type
Senior IC backend software engineer (Python, distributed systems)
Builds
Scalable event-driven systems and APIs powering content enrichment and metadata discovery
Domain
Digital publishing, document processing, machine learning infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, event-driven architecture, distributed systems, AWS services, Terraform, system performance optimization
Preferred skills
Scala, Spark, Databricks, workflow orchestration, ML/LLM integration
Technologies
Python, AWS (Lambda, ECS, SQS, ElastiCache, CloudWatch), Airflow, Spark, Databricks, Terraform, Datadog
Responsibilities
Design and implement event-driven, distributed systems for metadata processing; Build and maintain scalable APIs for high-throughput content processing; Leverage AWS services to deploy resilient, high-performance systems; Collaborate with cross-functional teams to deliver backend solutions for ML-driven features; Optimize and refactor existing backend systems for scalability and reliability; Ensure system health and data integrity through monitoring and automated testing
Seniority
Senior, hands-on IC
