Backend Software Engineer, ML Inference
Core
Design, build, and scale core backend systems and infrastructure to serve Prior Labs' tabular foundation models (e.g., TabPFN) in production.
Role type
Senior Backend Software Engineer (ML Inference)
Builds
Scalable production APIs, inference serving systems, and cloud infrastructure for foundation models.
Domain
Artificial Intelligence / Machine Learning / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Machine Learning, Backend Engineering, Cloud Platforms, Infrastructure as Code (Terraform), Containerization (Docker, Kubernetes), API Design, MLOps, Inference Optimization
Preferred skills
PyTorch, FastAPI, GCP, Model Serving Frameworks, Feature Stores, Open Source Contributions
Technologies
Python, PyTorch, FastAPI, Terraform, Docker, Kubernetes, GCP
Responsibilities
Own the end-to-end inference serving path (latency, throughput, batching, memory); Design robust, scalable, and secure backend systems; Develop high-quality, maintainable code for core backend services; Design, deploy, and manage core infrastructure on cloud platforms; Implement secure, GDPR-compliant systems; Drive high standards for testing, CI/CD, and security.
Seniority
Senior, hands-on IC
