CareerPlan

Lead/Senior Engineer, Model Inference

Switzerland, Zug, ZugFull-time2026-11-18 → 2026-11-19

Core

Build and operate Mariner, Thomson Reuters' custom inference platform serving production traffic for the Thomson LLM model family and frontier models.

Role type

Senior IC infrastructure engineer (model inference)

Builds

Model-serving infrastructure (Mariner) for Thomson's AI products

Domain

AI/ML infrastructure, large-scale distributed systems, regulated professional workflows

Deliverable

production ML models

Required skills

Kubernetes, model-serving infrastructure, inference optimization, distributed systems, production incident management, end-to-end software shipping, technical mentorship

Preferred skills

LLM-serving stacks (vLLM, TensorRT-LLM, Triton, SGLang), GPU-cluster capacity planning, regulated environments (ISO 27001), systems languages (Rust, Go), systems-level optimization

Technologies

Kubernetes, vLLM, TensorRT-LLM, Triton, SGLang, Rust, Go

Responsibilities

Build and operate model-serving infrastructure; implement inference-optimization techniques; improve observability; implement compliance controls and cost-tracking; document cost/latency/reliability tradeoffs; collaborate with training/evaluation pods; establish team practices and tooling

Seniority

Senior, hands-on IC with founding team autonomy