Staff Software Engineer, Big Data Storage
Core
Designing and building exabyte-scale data lake storage platforms and metadata management systems to power Pinterest's data infrastructure.
Role type
Staff Software Engineer (Big Data Storage)
Builds
Exabyte-scale data lake storage platform, metadata management capabilities, and storage layers for ML/AI workloads.
Domain
Big Data Infrastructure / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Designing large-scale production distributed systems, scalable storage and metadata infrastructure, building storage for ML/AI/analytics workloads, distributed systems architecture, open source community engagement, Java/Scala/Python programming, leading complex technical initiatives.
Preferred skills
Experience with Apache Iceberg, Spark, Flink, Presto/Trino, Hive, schema evolution, large-scale column backfills.
Technologies
Apache Iceberg, Spark, Flink, Presto/Trino, Hive, Java, Scala, Python
Responsibilities
Design and optimize exabyte-scale data lake storage; lead technical projects from architecture to execution; collaborate on storage technologies enabling ML/AI innovations; build capabilities for high-throughput data access and schema evolution; shape long-term technical direction; contribute to open source communities.
Seniority
Staff, technical leadership & hands-on contribution
