Software Engineering II and Senior Software Engineer (CoreAI - Post Training)
Core
Build and evolve distributed services underpinning massive training runs, improve iteration loops for researchers, and apply performance optimization techniques to impact product quality and operational excellence.
Role type
Senior IC Software Engineer (ML Systems & AI Infrastructure)
Builds
Distributed services, ML systems, AI infrastructure, and compute orchestration platforms.
Domain
Artificial Intelligence, Machine Learning, Cloud Infrastructure, High-Performance Computing.
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, Performance optimization, ML systems architecture, Compute orchestration, Cloud software development, Containerization, GPU computing, Reinforcement learning, Post-training techniques, Inference technologies (vLLM, SGLang), Training orchestration (VERL, Slime, Ray), Model modification and optimization.
Preferred skills
Experience with disaggregated inference, Knowledge of training and orchestration technologies, Ability to modify and optimize models and training/inference systems.
Technologies
vLLM, SGLang, VERL, Slime, Ray, C, C++, C#, Python, Java.
Responsibilities
Build and evolve distributed services for massive training runs, Apply advanced performance optimization techniques, Improve iteration loops for researchers and engineers, Develop deep expertise in ML systems and AI infrastructure, Maintain operations of live site services and implement mitigations for complex issues, Contribute to architecture design and design documents, Ensure security best practices and implement security monitoring for AI production systems.
Seniority
Senior, hands-on IC