Engineering Manager
Core
Leading the ingestion platform that pulls metadata from 100+ external systems into DataHub's enterprise context platform to ensure AI agents are reliable and accurate.
Role type
Senior Engineering Manager, Ingestion
Builds
High-throughput ingestion framework, Remote Executor platform, and AI-driven agent solutions for customer onboarding and troubleshooting.
Domain
Enterprise AI & Data Context / Metadata Management
Deliverable
production ML models | infrastructure
Required skills
Distributed systems, cloud infrastructure, scalable backend architecture, global team management, cross-functional leadership, technical strategy, platform reliability
Preferred skills
Connectors and integrations, ETL, metadata systems, developer platforms, SDKs, remote execution infrastructure, Python-based ingestion systems, cloud-native execution
Technologies
BigQuery, Microsoft Fabric, SageMaker, Tableau, Python
Responsibilities
Lead the evolution of the ingestion framework for high-throughput metadata handling; Spearhead development of intelligent agent-based solutions; Partner with Product and Customer Success to resolve issues and improve stability; Drive down technical debt and invest in developer productivity.
Seniority
Senior, hands-on IC with management responsibilities