Machine Learning Engineer 5
Core
Build LLM-powered systems to simulate consumer audiences for pre-testing ads and campaigns.
Role type
Senior IC machine learning engineer (LLM applications)
Builds
Synthetic audiences, LLM-powered simulated consumers, inference harnesses, evaluation datasets
Domain
Marketing technology, Generative AI, Consumer behavior modeling
Deliverable
production ML models
Required skills
LLM application development, complex inference harness design, LLM fine-tuning (SFT, DPO, GRPO), RLHF/RLAIF, evaluation dataset creation, Python, PyTorch, Hugging Face, vLLM, MLOps, cloud ML services
Preferred skills
Synthetic audiences research, persona simulation, public opinion/survey data analysis
Technologies
PyTorch, Hugging Face, vLLM, W&B, AWS, GCP, Azure
Responsibilities
Design and ship LLM-powered systems from proof-of-concept to production; Develop complex inference and reasoning harnesses; Fine-tune LLMs on survey and behavioral data; Build evaluation datasets and benchmarks; Partner with product and engineering teams
Seniority
Senior, hands-on IC
