Palantir Data Pipeline & Metadata Lead
Core
Senior technical leader establishing and scaling enterprise data pipelines and metadata foundations to enable AI-driven capabilities, analytics, and system integration within Palantir Foundry.
Role type
Senior IC Data Pipeline & Metadata Lead
Builds
Production-grade data pipelines, metadata frameworks, ontologies, and AI-ready data foundations for enterprise analytics and AI/ML use cases.
Domain
Enterprise Data Engineering & AI/ML Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Palantir Foundry expertise, Palantir AIP expertise, data architecture, data governance, metadata management, team leadership, cloud data pipelines (AWS), Databricks/Spark integration, Python, SQL, document processing (OCR/ICR), Agile delivery.
Preferred skills
Federal sector experience, data lake/lakehouse architecture, enterprise ML platforms, graph-based data models, consulting experience.
Technologies
Palantir Foundry, Palantir AIP, AWS, Databricks, Spark, Python, SQL
Responsibilities
Lead design and governance of enterprise data pipelines and metadata frameworks; define metadata standards, ontologies, and data models; oversee end-to-end pipeline implementation including ingestion, validation, and transformation; establish data quality and exception handling processes; enable AI-ready data foundations for semantic search and entity resolution; partner with data science teams to support AI/ML workflows; drive data governance, lineage tracking, and compliance; mentor cross-functional teams; engage stakeholders to define data strategy.
Seniority
Senior, hands-on IC with leadership responsibilities