Lead Data Engineer
Core
Design and build complex data solutions for enterprise clients, from discovery through to production, focusing on data pipelines, models, and AI-enabled features.
Role type
Senior hands-on IC data engineer
Builds
Production-grade data pipelines, data models, and AI-enabled features (e.g., RAG) on cloud platforms
Domain
Enterprise software, cloud data platforms (AWS/Azure), data engineering, and AI integration
Deliverable
production ML models | product features
Required skills
SQL, Python/PySpark, Parquet, Iceberg, JSON, AWS native services, Azure native services, Databricks, Snowflake, medallion architecture, data mesh/fabric, RAG patterns, data quality, governance, metadata cataloguing, batch and streaming pipelines
Preferred skills
Performance tuning, industry standards knowledge, public speaking at conferences, cross-platform expertise (AWS/Azure/Databricks/Snowflake)
Technologies
AWS (S3, Glue, Redshift, Lake Formation), Azure (Fabric, Synapse, Purview), Databricks, Snowflake, Parquet, Iceberg, JSON
Responsibilities
Build pipelines and design data models, pair with engineers and designers, mentor less experienced engineers, contribute to technical decisions, communicate trade-offs to non-technical audiences, support client upskilling
Seniority
Senior, hands-on IC
