Software Engineer, Data Infrastructure
Core
Design, build, and operate massive data infrastructure (compute, storage, streaming) supporting OpenAI's product, research, and analytics workflows.
Role type
Senior IC data infrastructure engineer
Builds
Distributed compute fleets, data lakes, metadata systems, high-throughput streaming platforms, and ML feature engineering tooling
Domain
AI research and deployment, big data infrastructure
Deliverable
infrastructure
Required skills
distributed systems architecture, big data compute scaling, streaming system design, data orchestration, infrastructure as code, debugging large-scale systems, reliability engineering
Preferred skills
experience with Spark, Kafka, Flink, Airflow, Trino, or Iceberg, knowledge of Terraform, ability to work in ambiguous environments
Technologies
Spark, Kafka, Flink, Airflow, Trino, Iceberg, Terraform, Chronon
Responsibilities
Design and maintain distributed compute, storage, and streaming systems; ensure platform scalability and efficiency; empower teammates with data tooling; collaborate with product and research teams; own system reliability including on-call rotation
Seniority
Senior, hands-on IC