Data Engineer
Core
Design, build, and manage data pipelines and core tables to power analyses, safety systems, product growth, and model training for OpenAI's AI products.
Role type
Senior Data Engineer
Builds
Data pipelines, canonical datasets, and fault-tolerant data ingestion/processing systems for OpenAI's research and product teams.
Domain
Artificial Intelligence / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, or Java; distributed processing frameworks (Hadoop, Flink); ETL schedulers (Airflow, Dagster, Prefect); Spark development and optimization; data architecture design.
Preferred skills
Experience collaborating with research and product teams; knowledge of data security and compliance standards.
Responsibilities
Design and manage data pipelines for user event integration; develop canonical datasets for product metrics; implement robust data ingestion and processing systems; participate in data architecture decisions; ensure data security and compliance.
Seniority
Senior, hands-on IC