Manager I, Engineering - AI Platform - Training & Serving
Core
Manage and scale the AI platform's Training & Serving team to enable large-scale foundation model training and inference for data scientists and engineers.
Role type
Engineering Manager (AI Platform)
Builds
Distributed training infrastructure for foundation models and scalable serving systems for Datadog's AI products (Bits AI, LLMObs).
Domain
AI Infrastructure / Machine Learning Operations
Deliverable
production ML models | infrastructure
Required skills
Team leadership (10+ engineers), technical roadmap definition, backend/data engineering/infrastructure expertise, hands-on coding and code review, cross-functional partnership, AI coding tools proficiency.
Preferred skills
Early-stage project experience, building AI-enabled products, pushing AI boundaries in software engineering.
Technologies
Foundation models, distributed training frameworks, serving systems, storage infrastructure, data pipelines.
Responsibilities
Manage and grow a team of 10+ engineers; Define technical roadmap aligned with AI platform goals; Partner with core platform teams to tailor storage and infrastructure; Participate in hands-on work including code and design reviews.
Seniority
Manager I, hands-on IC leader