Backend Engineer - Data Platform
Core
Building a Lakehouse architecture using Apache Iceberg and managing BigQuery at Spotify scale to enable reliable, cost-efficient data storage and querying for thousands of engineers and data scientists.
Role type
Senior Backend Engineer (Data Platform)
Builds
Production-grade Lakehouse platform (Apache Iceberg) and BigQuery management tooling
Domain
Big Data / Cloud Data Warehousing / Distributed Systems
Required skills
Java or Scala, GCP, Kubernetes, Apache Iceberg, BigQuery, Spark/Beam/Flink, system design, production debugging (via careerplan.io/jobs/926149ab-6999-4058-b35d-41e302b70e05-backend-engineer-data-platform-at-spotify)
Preferred skills
Open table formats, cloud data warehouse internals, asynchronous communication
Technologies
Apache Iceberg, BigQuery, GCP, Kubernetes, Spark, Beam, Flink
Responsibilities
Build foundations for reading/writing Iceberg tables natively, migrate data pipelines to new stack, manage BigQuery reservations and capacity, debug production issues across storage formats and cloud services
Seniority
Senior, hands-on IC
