CareerPlanSign in

Distinguished Architect, AI

New York💼 Full-time💰 $300,000–$300,000🗓 2026-05-29 → 2026-09-26

Core

Act as a technical multiplier for leading AI labs and AI-native companies, bridging their infrastructure aspirations with Datadog's observability platform to solve challenges in training and deploying foundational models at scale.

Role type

Distinguished Architect (AI/LLM)

Builds

Custom observability integrations and solutions for high-throughput hyper-scale AI workloads

Domain

AI/LLM Observability, Distributed Systems, High-Performance Computing

Deliverable

production ML models | product features | client delivery

Required skills

At-scale distributed systems architecture, high-performance computing, accelerator hardware (GPUs/TPUs), modern orchestration frameworks, AI/LLM ecosystem knowledge, LLMO best practices, executive-level stakeholder influence, technical presentation, product feedback loop management

Preferred skills

Master's degree in engineering

Technologies

GPUs, TPUs, orchestration frameworks

Responsibilities

Lead deep-dive architecture reviews and design engagements with customer teams and leaders, identify emerging AI-native technology shifts to feed Product Management, assist leadership in recruiting top talent for PSA and Field CTO teams, guide technical founders and research leads on AI/LLM best practices

Seniority

Distinguished, strategy & mentorship

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.