CareerPlanGet AI match score →

Member of Technical Staff, Cloud Infrastructure

New York💼 Full-time💰 $175,000–$175,000🗓 2026-06-10 → 2026-07-31

Core

Architecting and building foundational cloud infrastructure systems to power Fireworks AI's generative AI platform, enabling scalable inference and distributed training globally.

Role type

Senior IC cloud infrastructure engineer (ML platforms)

Builds

Virtual cloud infrastructure for AI workloads, including job schedulers, resource managers, autoscalers, and model serving layers.

Domain

Generative AI infrastructure / Cloud-native distributed systems

Deliverable

production ML models | infrastructure

Required skills

Distributed systems design, Cloud-native infrastructure, Python or C++ development, ML infrastructure tooling, System reliability engineering, Observability and monitoring

Preferred skills

Infrastructure-as-code (Terraform, ArgoCD), CI/CD tooling, Open-source contributions, Large-scale ML workload leadership

Technologies

Kubernetes, Kubeflow, MLFlow, AWS, GCP, Azure, PyTorch, TensorFlow, Vertex AI, SageMaker

Responsibilities

Architect scalable backend infrastructure for distributed training and inference; Lead technical design and mentor engineers; Design core backend services for efficiency and low latency; Drive compute cost reduction and storage lifecycle management; Collaborate with ML and product teams to translate needs into infrastructure solutions; Develop comprehensive monitoring, alerting, logging, and tracing solutions.

Seniority

Senior, hands-on IC

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Greenhouse ↗