Backend Engineer II - Data Platform
Core
Building and maintaining the source of truth for Spotify's data ecosystem, ensuring metadata accuracy, lineage tracking, and schema management across batch and streaming workloads.
Role type
Senior IC backend engineer (data platform)
Builds
Data catalog systems, lineage tracking tools, and metadata management infrastructure for Spotify's platform teams.
Domain
Music streaming / Data engineering
Deliverable
production ML models | infrastructure
Required skills
Data catalog design, lineage tracking, schema evolution management, batch and streaming data handling, open standards implementation (OpenLineage, Apache Iceberg), internal standard definition.
Preferred skills
Experience with large-scale data platforms, evolving storage technologies, metadata governance.
Technologies
OpenLineage, Apache Iceberg
Responsibilities
Design and implement systems for accurate data cataloging at scale, capture lineage across diverse data workloads, manage evolving schemas, define internal standards for naming and storage.
Seniority
Senior, hands-on IC