Senior Data Engineer, AI & Agents
Core
Build and register domain-grounded data agents over governed datasets to enable AI agent consumption of enterprise data.
Role type
Senior IC data engineer (AI agents & lakehouse)
Builds
Domain data agents, lakehouse migrations, and catalogue metadata for downstream automation
Domain
Enterprise data platforms, AI agents, and regulated data domains (life sciences, finance, R&D)
Deliverable
production ML models | product features
Required skills
Data engineering, Databricks, Snowflake, SQL, PySpark, pipeline orchestration (dbt, Airflow), data quality/observability, data governance (masking, row/column security), stakeholder management
Preferred skills
MCP-based data exposure, embeddings/vector search, AWS/S3, regulated life-sciences data domains
Technologies
Databricks, Snowflake (Cortex, Genie), AWS, S3, Unity Catalogue, Horizon, Collibra, Python, YAML, Apache Iceberg, Git, CI/CD
Responsibilities
Build and register domain data agents at scale over governed tables; Perform lakehouse migrations converting source tables to open formats (e.g., Apache Iceberg); Generate and curate catalogue metadata for automation workflows; Partner with business stakeholders and subject-matter experts through iterative build, test, and validation cycles
Seniority
Senior, hands-on IC