Lead Data Engineer 2026- US, COL, UK
Core
Design and implement AI-optimized data platforms, including cloud data warehouses, lakehouses, and ETL/ELT pipelines to support LLM-driven analytics and agent-based workflows for clients.
Role type
Lead Data Engineer (AI-forward data platforms)
Builds
Cloud data warehouses, lakehouses, ETL/ELT pipelines, orchestration jobs, and analytic layers
Domain
Data Engineering / AI / Cloud Infrastructure
Required skills
SQL, Python, Spark, data modeling (star schema, ER, data vault), DevOps, cloud data warehouses (Snowflake, Databricks), cloud ETL/ELT tools, container technologies
Preferred skills
dbt Core/Cloud, AI-assisted coding tools (Codex, Copilot, Cortex, Genie), Apache Spark, data science workflow, consulting experience
Technologies
Snowflake, Databricks, dbt, Fivetran, AWS, Azure, GCP, Docker, Kubernetes, Apache Spark
Responsibilities
Design and implement AI-optimized data platforms; Engineer modern ELT/ETL pipelines for structured, semi-structured, and unstructured data; Write production-ready code in SQL, Python, and Spark; Collaborate with analytics and data science teams to productionize AI-enabled analytics; Lead small team project delivery or work independently on client engagements.
Seniority
Senior, hands-on IC with team leadership