Member of Technical Staff, Evals & Post-Training Product
Core
Build products and workflows connecting evaluation and post-training into a continuous loop for internal teams and external developers.
Role type
Senior IC product engineer (LLM evals & post-training)
Builds
Internal evaluation tooling, fine-tuning product experiences (SFT, RFT), and open-source Eval Protocol SDK
Domain
Generative AI infrastructure, model evaluation, and post-training
Deliverable
production ML models | product features
Required skills
LLM evaluation design, post-training methods (SFT, RFT), full-stack product engineering, GenAI lifecycle understanding, user-centric product development
Preferred skills
Domain-specific evaluation experience (medical, legal, coding), open-source contributions, inference & hardware optimization knowledge, startup environment experience
Technologies
APIs, SDKs, backend systems, web app, open-source Eval Protocol SDK
Responsibilities
Design and scale internal evaluation tooling for model quality measurement; Build and improve user-facing fine-tuning workflows; Partner with customers and stakeholders to productize bespoke evaluation and fine-tuning needs
Seniority
Mid-to-Senior, hands-on IC
