Software Engineer, Enterprise AI

💼 Full-time🗓 2026-08-13 → 2026-08-14

Core

Building and scaling an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, and evaluation.

Role type

Senior IC software engineer (enterprise AI platform)

Builds

Enterprise Generative AI platform APIs

Domain

Generative AI / Enterprise Software

Deliverable

production ML models | product features

Required skills

distributed systems, LLM integration, vector databases, Python, TypeScript, SQL, Kubernetes, cloud platforms (AWS/Azure/GCP)

Preferred skills

scaling products at hyper-growth startups, rapid technology adoption

Responsibilities

Own large new product areas, work across backend/frontend/LLM layers, deliver high-velocity experiments, manage full product lifecycle

Seniority

Senior, hands-on IC

Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.

About Scale AI

Series D5000 Employees

Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector Engineering team. As a part of this team, you will own the model inference layer - enabling state of the art models, debugging the latest AI tools, managing networking, debugging latency, and tracking pricing/usage metrics for AI models. You will lead technical discussions on the frontlines with cloud vendors and customers to deliver on critical contracts and to debug platform issues. You will also work upstream with Product to understand features before they break