Inference Technical Lead, Sora
Core
Optimizing GPU inference performance and scalability for OpenAI's Sora multimodal foundation model.
Role type
Senior IC GPU Inference Engineer
Builds
High-throughput, reliable model serving infrastructure for multimodal AI products
Domain
Generative AI / Multimodal Systems
Deliverable
production ML models
Required skills
GPU inference optimization, kernel-level systems programming, data movement optimization, low-level performance tuning, distributed systems design
Preferred skills
Model design for inference efficiency, scaling high-performance AI systems, navigating technical ambiguity
Technologies
CUDA, PyTorch, Kubernetes, gRPC
Responsibilities
Optimize model serving efficiency and system throughput, drive kernel and data movement optimizations, partner with research teams on inference-friendly model design, build and improve critical serving infrastructure
Seniority
Senior, hands-on IC