Software Engineer (Inference Platform), London
Core
Building and scaling the inference platform to serve fleets of cutting-edge machine learning models for drug discovery applications.
Role type
Senior IC software engineer (ML inference platform)
Builds
High-throughput, reliable ML model serving infrastructure for scientific applications
Domain
Biotech / Drug Discovery / Machine Learning Infrastructure
Deliverable
production ML models
Required skills
Kubernetes, cloud-native ML lifecycle management, distributed systems, high-throughput architectures, Infrastructure as Code, CI/CD pipelines, observability
Preferred skills
Google Cloud Platform (GCP), workload scheduling, ML efficiency research, hardware benchmarking, GPU-aware infrastructure, Triton, TF Serving
Technologies
KServe, Seldon, Kubernetes, GCP, Triton, TF Serving
Responsibilities
Develop and operate the inference platform serving ML model fleets; Optimize inference services to solve scaling limits and ensure high-throughput performance; Contribute to core technical decisions on tooling and architectural design; Deliver high-quality, well-tested user-focused features
Seniority
Senior, hands-on IC