Machine Learning Engineer
Core
Build and deploy end-to-end LLM models (training, fine-tuning, evaluation, serving) that run entirely on customer hardware within highly restricted, secure networks (nuclear plants, defense, banking).
Role type
Senior IC Machine Learning Engineer (On-Prem LLMs)
Builds
Production Rust services hosting quantized LLMs for file security and threat detection
Domain
Cybersecurity / Critical Infrastructure
Deliverable
production ML models
Required skills
Fine-tuning open-weight LLMs (LoRA/QLoRA), Python data pipelines, Retrieval-Augmented Generation (RAG), LLM serving/inference (vLLM/Ollama), Model evaluation metrics, SQL
Preferred skills
Rust, Agent frameworks (ADK), LLM security (prompt injection mitigation), On-prem/edge deployment, Evaluation tooling (LLM-as-judge)
Technologies
Python, Rust, vLLM, Ollama, LoRA, QLoRA, SQL
Responsibilities
Own the full model lifecycle from data preparation to release; Build evaluation gates to ensure model reliability; Construct data pipelines for grounded generation; Optimize model inference for constrained hardware; Integrate models into production Rust services; Secure models against prompt injection and data leakage
Seniority
Senior, hands-on IC
