Senior Software Engineer
Core
Build self-serve tools, APIs, and workflows for deploying, configuring, validating, and operating machine learning models; optimize Kubernetes deployment and resource management for CPU and GPU workloads.
Role type
Senior Software Engineer (ML Infrastructure)
Builds
Production ML inference services, self-serve developer platforms, and disaggregated serving architecture
Domain
Machine Learning Infrastructure / Cloud Systems
Deliverable
production ML models
Required skills
Backend or systems programming (Java, Kotlin, Go, C++, Python), distributed systems, concurrency, networking, Kubernetes, CPU/GPU profiling, operational data analysis
Preferred skills
ML inference infrastructure, online feature retrieval, inference runtimes, model deployment workflows, open-source infrastructure
Technologies
Kubernetes, Java, Kotlin, Go, C++, Python
Responsibilities
Build self-serve tools and APIs for ML model deployment; Integrate open-source inference frameworks into production services; Optimize request routing and model inference performance; Develop integrations and migration tooling for new serving capabilities; Use benchmarking and tracing to improve reliability and cost; Participate in on-call and production support
Seniority
Senior, hands-on IC
