CareerPlan

Senior Software Engineer

USAFull-time2026-11-12 → 2026-11-18
Based in United States

Core

Build self-serve tools, APIs, and workflows for deploying, configuring, validating, and operating machine learning models; optimize Kubernetes deployment and resource management for CPU and GPU workloads.

Role type

Senior Software Engineer (ML Infrastructure)

Builds

Production ML inference services, self-serve developer platforms, and disaggregated serving architecture

Domain

Machine Learning Infrastructure / Cloud Systems

Deliverable

production ML models

Required skills

Backend or systems programming (Java, Kotlin, Go, C++, Python), distributed systems, concurrency, networking, Kubernetes, CPU/GPU profiling, operational data analysis

Preferred skills

ML inference infrastructure, online feature retrieval, inference runtimes, model deployment workflows, open-source infrastructure

Technologies

Kubernetes, Java, Kotlin, Go, C++, Python

Responsibilities

Build self-serve tools and APIs for ML model deployment; Integrate open-source inference frameworks into production services; Optimize request routing and model inference performance; Develop integrations and migration tooling for new serving capabilities; Use benchmarking and tracing to improve reliability and cost; Participate in on-call and production support

Seniority

Senior, hands-on IC