Senior Data Engineer (6-month contract)
Core
Senior Data Engineer building robust data platforms and AI-enabled solutions on Microsoft Azure to support client digital transformation and decision-making.
Role type
Senior hands-on IC data engineer
Builds
Data ingestion/orchestration pipelines, ETL/ELT pipelines, and data platforms for analytics, reporting, and AI
Domain
Technology consulting, Data Engineering, Cloud (Azure)
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Azure Data Factory, Azure Databricks, Delta Lake, Azure Data Lake Storage, Azure SQL, Data modelling, API integration, Azure AI services, Terraform, Bicep, Azure DevOps, Git
Preferred skills
Enterprise system integration, Data governance, Data quality testing, AI-assisted development
Technologies
Azure, Databricks, PySpark, Terraform, Bicep, Azure DevOps, GitHub
Responsibilities
Design and operate ingestion and orchestration pipelines in Azure Data Factory; Develop ETL/ELT in Azure Databricks using medallion architecture; Lead code reviews and set engineering standards; Shape data architecture decisions including metric definitions and semantic models; Apply data governance, security and access controls; Use AI-assisted development tools responsibly.
Seniority
Senior, hands-on IC with mentoring responsibilities