Data Scientist, Inference Capacity Optimization
Core
Build statistical and machine learning models to profile, forecast, and optimize GPU utilization, latency, and throughput for OpenAI's global inference fleet.
Role type
Senior IC data scientist (infrastructure capacity optimization)
Builds
Production ML models for capacity planning, forecasting, and fleet efficiency optimization
Domain
AI infrastructure / Cloud computing / GPU resource management
Deliverable
production ML models
Required skills
statistical modeling, forecasting, optimization, causal analysis, Python, SQL, experimentation design, bottleneck analysis
Preferred skills
capacity planning, distributed systems, queueing theory, time-series forecasting, operations research, reinforcement learning, cost optimization
Responsibilities
Build ML models to improve GPU utilization and fleet efficiency; Develop forecasting models for inference demand; Analyze production workloads to identify latency bottlenecks; Design experiments to evaluate scheduling policies; Build dashboards for leadership capacity decisions; Partner with engineering and product teams on infrastructure planning
Seniority
Senior, hands-on IC
