Software Engineer - ML Infrastructure
Core
Design and develop scalable, low-latency model inference infrastructure, high-performance post-training infrastructure for reinforcement learning (RL), distributed ML training job execution, and comprehensive model evaluation frameworks.
Role type
Senior IC ML Infrastructure Software Engineer
Builds
Scalable inference services, distributed training job execution systems, and automated model evaluation frameworks
Domain
AI/ML Infrastructure, Distributed Systems, Reinforcement Learning
Deliverable
production ML models
Required skills
Distributed systems design, GPU cluster management, Low-latency system architecture, RL post-training infrastructure, Model serving engines, Performance tuning, Fault tolerance design, Large-scale data platform engineering, PyTorch, Automated evaluation pipelines
Preferred skills
Experience with agentic coding workflows, RLHF pipelines
Technologies
PyTorch, Distributed training frameworks, Model serving engines, GPU clusters
Responsibilities
Architect and optimize LLM post-training infrastructure for RL, Design robust job execution systems for distributed ML training, Build automated model evaluation frameworks, Ensure high availability and low latency across GPU clusters, Collaborate with AI researchers to support evolving training needs
