Software Engineer AI Inference
Hybrid · European Union, Switzerland
Core
Design, build, and operate high-performance AI inference infrastructure to deploy LLMs and generative AI workloads at scale.
Role type
Senior Software Engineer (AI Inference Infrastructure)
Builds
Managed Inference platform, Generative APIs, AI HPC clusters, and internal AI tooling
Domain
Cloud Infrastructure, AI/ML, Distributed Systems
Deliverable
production ML models
Required skills
Golang, Kubernetes, Distributed Systems, GPU Infrastructure, vLLM, Triton, CUDA, Hugging Face, KServe
Responsibilities
Build and operate infrastructure for serving LLMs, Design and maintain Kubernetes-based services, Develop backend services in Golang, Optimize serving stacks, Integrate open-source AI tooling, Troubleshoot complex infrastructure issues
Seniority
Senior, hands-on IC