Member of Technical Staff, LLM & Production
Core
Build production infrastructure for LLM evaluation, data pipelines, and RL training environments to enable scalable model research and deployment.
Role type
Senior IC machine-learning engineer (LLM evaluation & training infrastructure)
Builds
Evaluation harnesses, data pipelines, RL training environments, and production-grade model training systems
Domain
Artificial Intelligence / Large Language Models / Machine Learning Infrastructure
Deliverable
production ML models
Required skills
Python, distributed systems, LLM evaluation infrastructure, SFT, RL, data pipeline engineering, reproducibility, test automation
Preferred skills
Agentic evaluation, training frameworks (PyTorch, JAX, vLLM, SGLang), data labeling operations, open-source contributions, verifiers/simulation environments
Technologies
Python, PyTorch, JAX, vLLM, SGLang
Responsibilities
Build end-to-end evaluation suites for LLM capabilities; Run evaluation harnesses as production services; Own data pipelines from source to training; Build RL training environments; Work with researchers to operationalize hypotheses; Integrate product capabilities into model training; Measure system health and model performance; Enforce code quality and reproducibility standards
Seniority
Senior, hands-on IC