Lead/Senior Engineer, Model Inference
Core
Build and operate Mariner, Thomson Reuters' custom inference platform serving production traffic for the Thomson LLM model family and frontier models.
Role type
Senior IC infrastructure engineer (model inference)
Builds
Model-serving infrastructure (Mariner) for Thomson's AI products
Domain
AI/ML infrastructure, large-scale distributed systems, regulated professional workflows
Deliverable
production ML models
Required skills
Kubernetes, model-serving infrastructure, inference optimization, distributed systems, production incident management, end-to-end software shipping, technical mentorship
Preferred skills
LLM-serving stacks (vLLM, TensorRT-LLM, Triton, SGLang), GPU-cluster capacity planning, regulated environments (ISO 27001), systems languages (Rust, Go), systems-level optimization
Technologies
Kubernetes, vLLM, TensorRT-LLM, Triton, SGLang, Rust, Go
Responsibilities
Build and operate model-serving infrastructure; implement inference-optimization techniques; improve observability; implement compliance controls and cost-tracking; document cost/latency/reliability tradeoffs; collaborate with training/evaluation pods; establish team practices and tooling
Seniority
Senior, hands-on IC with founding team autonomy