Senior Software Engineer, Agentic Platform
Core
Design, build, and optimize scalable machine learning infrastructure for training, evaluating, and deploying large language models.
Role type
Senior IC machine learning infrastructure engineer (LLM)
Builds
Scalable microservices, ETL pipelines, and productionized infrastructure for state-of-the-art models and large-scale ML systems
Domain
Artificial Intelligence / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, C++ or Go, PyTorch, Hugging Face, vLLM, TensorRT-LLM, end-to-end ML system design, scalable microservices, ETL pipelines, LLM latency optimization
Preferred skills
Machine learning and software engineering research publications
Technologies
PyTorch, Hugging Face, vLLM, TensorRT-LLM
Responsibilities
Design and optimize scalable ML infrastructure for LLM training and deployment; Build abstractions to automate ML workflows; Develop and productionize infrastructure for large-scale ML systems; Build scalable microservices and ETL pipelines; Optimize LLM latency; Collaborate with cross-functional teams on new features
Seniority
Senior, hands-on IC