CareerPlan

Backend Software Engineer, ML Inference

BerlinFull-time2026-11-18
Hybrid

Core

Design, build, and scale core backend systems and infrastructure to serve Prior Labs' tabular foundation models (e.g., TabPFN) in production.

Role type

Senior Backend Software Engineer (ML Inference)

Builds

Scalable production APIs, inference serving systems, and cloud infrastructure for foundation models.

Domain

Artificial Intelligence / Machine Learning / Cloud Infrastructure

Deliverable

production ML models

Required skills

Python, Machine Learning, Backend Engineering, Cloud Platforms, Infrastructure as Code (Terraform), Containerization (Docker, Kubernetes), API Design, MLOps, Inference Optimization

Preferred skills

PyTorch, FastAPI, GCP, Model Serving Frameworks, Feature Stores, Open Source Contributions

Technologies

Python, PyTorch, FastAPI, Terraform, Docker, Kubernetes, GCP

Responsibilities

Own the end-to-end inference serving path (latency, throughput, batching, memory); Design robust, scalable, and secure backend systems; Develop high-quality, maintainable code for core backend services; Design, deploy, and manage core infrastructure on cloud platforms; Implement secure, GDPR-compliant systems; Drive high standards for testing, CI/CD, and security.

Seniority

Senior, hands-on IC