Engineering Manager, Inference
Core
Lead engineering efforts to improve model performance and scale inference and training systems while removing bottlenecks and building robust solutions.
Role type
Engineering Manager, Inference & Scaling
Builds
Efficient and scalable inference and training systems for large AI models
Domain
Artificial Intelligence / Machine Learning / High-Performance Computing
Deliverable
production ML models
Required skills
Management of technical teams, distributed systems, machine learning fundamentals, project prioritization, stakeholder management, AI safety implications
Preferred skills
GPU/Accelerator programming, ML framework internals, OS internals, language modeling with transformers
Technologies
Transformers, GPUs, ML frameworks
Responsibilities
Provide front-line leadership of engineering efforts to improve model performance and scale systems, manage day-to-day execution of team work, coach and support reports in professional growth, prioritize team work in a dynamic environment, maintain deep understanding of technical work and AI safety implications
Seniority
Manager, hands-on technical leadership
