CareerPlanSign in

Senior Principal Machine Learning Engineer

San Jose, CA💼 Full-time💰 $220,000–$220,000🗓 2026-08-20 → 2026-09-26

Core

Designing, developing, and optimizing Large Language Models (LLMs) to run efficiently on SambaNova's specialized RDU hardware architecture.

Role type

Senior Principal Machine Learning Engineer (LLM & Hardware Co-design)

Builds

SambaStack and SambaCloud production systems

Domain

Generative AI / Large Language Models / Custom Hardware Accelerators

Deliverable

production ML models

Required skills

LLM training and fine-tuning, inference optimization, hardware-software co-design, ML algorithms and deep learning architectures, technical leadership, cross-functional alignment, high-complexity project delivery

Preferred skills

M.S. or Ph.D. in CS/EE, experience with non-GPU accelerators, publications or open-source contributions in LLMs, speculative decoding, mixture-of-experts, long-context modeling, reinforcement learning for post-training, compiler or kernel-level optimization

Technologies

RDU accelerators, SambaStack, SambaCloud, open-source LLMs

Responsibilities

Define technical strategy for ML model development and inference systems; Lead hardware-software co-design with compiler and systems teams; Identify and adapt state-of-the-art ML techniques for reconfigurable dataflow architectures; Serve as senior technical voice in design reviews and cross-functional planning; Mentor principal and senior ML engineers; Partner with leadership to translate ML capabilities into scalable customer solutions; Resolve complex, ambiguous technical challenges spanning organizational boundaries

Seniority

Principal, hands-on IC with strategic influence and mentorship

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.