Lead Data Engineer (10+ years with MS Fabric, Azure, ADF, Data Platforms only)
Core
Lead a team to design and build enterprise-scale, cloud-based data platforms and AI-ready data products using modern architectures.
Role type
Senior IC Lead Data Engineer (AI-first)
Builds
Scalable data platforms, data products, and AI-integrated solutions
Domain
Cloud data engineering, AI engineering, enterprise data architecture
Deliverable
production ML models
Required skills
Technical leadership, modern data architecture, Python, PySpark, SQL, data modeling, ETL/ELT pipelines, cloud platforms (Azure, Fabric, Databricks, Snowflake), APIs, CI/CD, observability, data governance, AI engineering practices
Preferred skills
Lakehouse architectures, Apache Spark, Delta Lake, Apache Iceberg, data-as-a-product principles
Technologies
Microsoft Fabric, Azure, Databricks, Snowflake, Python, PySpark, SQL, REST, GraphQL
Responsibilities
Provide hands-on technical leadership and mentor engineers; design scalable data platform architectures; champion AI-first engineering practices; build automated data quality and observability; design enterprise integration patterns; embed governance and security; partner with cross-functional teams.
Seniority
Senior, hands-on IC with leadership