Product ML Engineer
Core
Building efficient local AI systems by fine-tuning, optimizing, and deploying large language models (LLMs) and agent architectures for tool use and complex tasks.
Role type
Senior IC Product ML Engineer (LLMs & Agents)
Builds
Local AI systems, agent harnesses, tool-use architectures, and retrieval/memory systems for extended tasks.
Domain
Artificial Intelligence / Large Language Models / Edge Computing
Deliverable
production ML models
Required skills
LLM fine-tuning, model distillation, agent architecture design, retrieval systems, context management, quantization, speculative decoding, PyTorch, model training, inference optimization
Preferred skills
Experience with transformers, long-context processing, reinforcement learning, distillation, research implementation
Technologies
PyTorch, LLMs, Transformers, GitHub
Responsibilities
Fine-tune and optimize language models for tool use and agentic tasks; Build agent harnesses and planning/execution loops; Develop retrieval and memory systems for extended conversations; Experiment with quantization and speculative decoding for efficiency; Create benchmarks for agent capabilities and reliability; Prototype research ideas and integrate into production.
