Principal Engineer – Data Intelligence
Core
Architect and build AI-powered data intelligence platforms that reason over Yahoo's petabyte-scale data ecosystem to detect anomalies, diagnose incidents, and automate workflows.
Role type
Principal Engineer (IC5), hands-on IC with architectural leadership
Builds
Production RAG and multi-agent systems, semantic metadata integration, petabyte-scale batch/streaming pipelines
Domain
Enterprise data governance, large-scale distributed systems, agentic AI
Deliverable
production ML models | product features
Required skills
Distributed systems architecture, Python, batch/streaming processing (Kafka/Spark/Beam), RAG implementation, AI code validation, technical leadership
Preferred skills
Agentic AI frameworks (LangGraph, CrewAI), GCP Vertex AI, Knowledge graphs, AI pair-programming tools
Technologies
Beam, Dataflow, Spark, Kafka, GCP Vertex AI, Gemini, BigQuery, LangGraph, CrewAI, AutoGen
Responsibilities
Define technical vision for AI data platforms, architect petabyte-scale systems, build production RAG/agent systems, establish AI evaluation frameworks, drive adoption of AI development patterns
Seniority
Principal, hands-on IC with strategic influence
