ML Features Solutions Engineer
Core
Design and implement core ML features including model optimization, quantization, and inference enhancements for enterprise deployment on SambaNova hardware.
Role type
Senior IC ML Features Solutions Engineer
Builds
Production-ready ML solutions and platform capabilities for enterprise customers
Domain
Generative AI / Large Language Models / Enterprise Infrastructure
Deliverable
production ML models
Required skills
Large language models (LLMs), transformer architectures, Python, PyTorch, model optimization (quantization, pruning, distillation), LLM inference optimization (KV cache, batching, memory management), production deployment at scale
Preferred skills
PhD in ML/NLP, custom hardware acceleration (TPUs, ASICs), inference frameworks (vLLM, TensorRT-LLM), function calling, structured generation, open-source contributions
Technologies
SambaNova Suite, SN40L chip, PyTorch, TensorFlow, JAX, vLLM, TensorRT-LLM
Responsibilities
Design and implement core ML features including model optimization, quantization, and inference enhancements; Optimize model performance for latency, throughput, and memory efficiency on SambaNova hardware; Develop and improve features such as Function Calling, Structured Output, and JSON mode conformance; Create end-to-end ML solutions that showcase platform capabilities; Convert cutting-edge ML research into practical, deployable product features; Establish benchmarks and quality standards for ML features in production environments
Seniority
Senior, hands-on IC
