CareerPlan

Software Engineer AI Inference

ParisFull-time2026-07-24 → 2026-11-19
Hybrid · European Union, Switzerland

Core

Design, build, and operate high-performance AI inference infrastructure to deploy LLMs and generative AI workloads at scale.

Role type

Senior Software Engineer (AI Inference Infrastructure)

Builds

Managed Inference platform, Generative APIs, AI HPC clusters, and internal AI tooling

Domain

Cloud Infrastructure, AI/ML, Distributed Systems

Deliverable

production ML models

Required skills

Golang, Kubernetes, Distributed Systems, GPU Infrastructure, vLLM, Triton, CUDA, Hugging Face, KServe

Responsibilities

Build and operate infrastructure for serving LLMs, Design and maintain Kubernetes-based services, Develop backend services in Golang, Optimize serving stacks, Integrate open-source AI tooling, Troubleshoot complex infrastructure issues

Seniority

Senior, hands-on IC