CareerPlanGet AI match score →

Distinguished Architect, AI

New York💼 Full-time💰 $300,000–$300,000🗓 2026-05-29 → 2026-08-01

Core

Act as a technical multiplier for leading AI labs and AI-native companies, bridging their infrastructure aspirations with Datadog's observability roadmap to solve challenges in training and deploying foundational models at scale.

Role type

Distinguished Architect (AI/LLM)

Builds

Custom observability integrations and solutions for high-throughput hyper-scale AI workloads

Domain

AI/LLM infrastructure, Observability, High-Performance Computing

Deliverable

production ML models | product features | client delivery

Required skills

Distributed systems architecture, High-performance computing, AI/LLM ecosystem knowledge, Accelerator hardware (GPUs/TPUs), Modern orchestration frameworks, Architectural design, Technical thought leadership, Executive stakeholder management, Customer-facing presentation

Preferred skills

Master's degree in engineering

Technologies

GPUs, TPUs, Orchestration frameworks

Responsibilities

Demonstrate thought leadership in the AI/LLM space; Strategically partner with technical founders and research leads; Lead deep-dive architecture reviews and design engagements; Identify emerging AI-native technology shifts and feed them to Product Management; Collaborate with Sales and Marketing to provide technical resources; Assist leadership in recruiting top talent

Seniority

Distinguished, hands-on IC with strategic influence

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Greenhouse ↗