Lead Data Engineer - AWS / AI / SQL
Core
Lead the development of a modern, scalable data platform supporting Business Intelligence, Data Science, and Applied AI, while managing a small team of Data Engineers.
Role type
Lead Data Engineer (Team Lead)
Builds
Modern batch and real-time data-processing solutions, a Customer Data Platform, and a lakehouse architecture using AWS.
Domain
Data Engineering, Cloud Infrastructure (AWS), Business Intelligence
Required skills
AWS data services (S3, Lambda, Glue, Athena, Kinesis, RDS), SQL, Python, Terraform, CI/CD, Lakehouse architecture, Iceberg, Medallion architecture, Dimensional data modelling, Data governance, Team management
Preferred skills
PySpark, dbt tests, Great Expectations, Semantic modelling, MCP servers, Regulated environment experience
Technologies
AWS (S3, Lambda, Glue, Athena, Kinesis, RDS), SQL Server, SSIS/SSDT, Power BI, Terraform, Flink, Iceberg, dbt, Great Expectations
Responsibilities
Own the reliability, security, and ongoing development of the data platform; Modernise the existing SQL Server, SSIS/SSDT and Power BI environment; Develop scalable batch and real-time data-processing solutions; Lead the design of a Customer Data Platform; Build and evolve a lakehouse architecture using AWS technologies; Create governed semantic models, consistent metrics and clear data definitions; Enable secure, self-service data analysis using modern AI tooling; Automate manual, repetitive or fragile data processes; Support BI, Data Science, Machine Learning and Applied AI teams; Take ownership of data governance, security, monitoring and platform costs; Line-manage, develop and help grow the Data Engineering team.
Seniority
Lead, hands-on IC with team management
