Member of Technical Staff - Data Platform
Core
Build and operate the core data systems and pipelines powering research, training, and production environments for open AI models.
Role type
Senior IC data platform engineer
Builds
Company-wide foundations platform for data ingestion, processing, and orchestration
Domain
AI/ML infrastructure, data engineering, cloud platforms
Deliverable
production ML models
Required skills
large-scale batch and streaming data pipeline design, compute and storage foundation development, data quality and lineage management, cost and performance optimization, system debugging, reproducible experimentation
Preferred skills
zero-to-one system building, high-agency execution, cross-functional collaboration
Technologies
Spark, Flink, Beam, Airflow, Dagster, Kafka, PubSub, Parquet, Iceberg, Delta Lake, BigQuery, Snowflake, Great Expectations
Responsibilities
Design ingestion and orchestration patterns for batch and streaming workloads; Build scalable compute and storage foundations; Ensure reproducible pipelines through versioning and isolated execution; Provide trusted data quality and governance signals; Maintain predictable cost and performance through system tuning; Enable a unified data layer across the model development lifecycle
Seniority
Senior, hands-on IC
