Staff Engineer, Datalake Platform
Core
Architecting and migrating Stripe's foundational data lake infrastructure to modern open-source solutions like Apache Iceberg, serving petabytes of data for internal engineering teams.
Role type
Staff Engineer, Datalake Platform
Builds
Unified Iceberg metastore service, object storage abstraction layer, and compliance architecture for data governance.
Domain
Financial technology / Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Distributed storage systems design, Object storage (S3/Azure Blob) management, API design, Cross-team migration leadership, Authorization and access control design
Preferred skills
Apache Iceberg internals and REST Catalog, Compliance-sensitive infrastructure (SOX/ICFR), Large-scale data migration strategy, Developer experience (DX) sensibility
Technologies
Apache Iceberg, Spark, Trino, Flink, PyIceberg, S3, Azure Blob
Responsibilities
Architect the unified Iceberg platform as the single source of truth for table management; Own the metastore migration strategy from Hive to the new platform; Shape the object storage abstraction layer including access control and client libraries; Lead compliance architecture to translate regulatory requirements into technical controls; Drive cost and efficiency at petabyte scale; Set the technical bar through design reviews and mentorship
Seniority
Staff, hands-on IC with strategic influence
