Software Engineer 3
Core
Build systems, tooling, and deployment workflows to deliver Voyage embedding and reranking models to third-party inference providers and self-managed environments.
Role type
Senior IC backend/infrastructure engineer (ML model serving)
Builds
Third-party deployment pipelines for Voyage AI models across AWS, Azure, and GCP
Domain
Cloud infrastructure, ML model serving, multi-cloud deployment
Deliverable
production ML models
Required skills
Python or Go, cloud environments (AWS/Azure/GCP), containers, Kubernetes, CI/CD tooling, debugging across stack, ML model serving concepts
Preferred skills
vLLM, Triton, TGI, Prometheus, Grafana, OpenTelemetry, cloud marketplace experience, open-source contributions (via careerplan.io/jobs/13758-software-engineer-3-at-mongodb)
Technologies
Python, Go, AWS, Azure, GCP, Kubernetes, Prometheus, OpenTelemetry, vLLM, Triton, TGI
Responsibilities
Port and tune model servers for inference performance and consistency; own packaging and deployment workflows for third-party clouds; build validation tools to ensure deployment correctness; implement observability (logging, metrics, health checks); debug cross-stack issues involving model servers and cloud configs; partner with GTM and customers on external deployments
Seniority
Senior, hands-on IC
