Senior Staff Software Engineer
Core
Design, build, and optimize scalable machine learning infrastructure for large language model training, evaluation, and deployment.
Role type
Senior Staff Software Engineer (ML Infrastructure)
Builds
Scalable ML systems, microservices, ETL pipelines, and production services for state-of-the-art models.
Domain
Machine Learning Infrastructure / Large Language Models
Deliverable
production ML models
Required skills
Deep learning frameworks (PyTorch, Hugging Face), LLM serving frameworks (vLLM, TensorRT-LLM), Python, C++ or Go, scalable microservices, ETL pipelines, end-to-end ML system design
Preferred skills
Machine learning and software engineering research publications
Technologies
PyTorch, Hugging Face, vLLM, TensorRT-LLM, Python, C++, Go
Responsibilities
Design and optimize ML infrastructure for LLM training and deployment; Build abstractions to automate ML workflows; Build and scale ML systems and microservices; Collaborate with cross-functional teams to deliver features; Drive best practices in ML and data engineering
Seniority
Senior Staff, hands-on IC