CareerPlan

Distinguished Architect, AI

New YorkFull-time$300k2026-05-29 → 2026-11-10
Hybrid

Core

Act as a technical multiplier for leading AI labs and AI-native companies, bridging their infrastructure aspirations with Datadog's observability platform to solve challenges in training and deploying foundational models at scale.

Role type

Distinguished Architect (AI/LLM)

Builds

Custom observability integrations and solutions for high-throughput hyper-scale AI workloads

Domain

AI/LLM Observability, Distributed Systems, High-Performance Computing

Required skills

At-scale distributed systems architecture, high-performance computing, accelerator hardware (GPUs/TPUs), modern orchestration frameworks, AI/LLM ecosystem knowledge, LLMO best practices, executive-level stakeholder influence, technical presentation, product feedback loop management

Preferred skills

Master's degree in engineering

Technologies

GPUs, TPUs, orchestration frameworks

Responsibilities

Lead deep-dive architecture reviews and design engagements with customer teams and leaders, identify emerging AI-native technology shifts to feed Product Management, assist leadership in recruiting top talent for PSA and Field CTO teams, guide technical founders and research leads on AI/LLM best practices

Seniority

Distinguished, strategy & mentorship