Lead data engineer
Core
Designing, implementing, and maintaining scalable data pipelines and infrastructure in the Azure cloud environment.
Role type
Lead data engineer (Azure)
Builds
Scalable data pipelines and data integration/transformation processes
Domain
Cloud data engineering (Azure)
Deliverable
production ML models | infrastructure
Required skills
SQL, Python, Azure Data Factory, Azure Databricks, Azure SQL Database, Spark, PySpark
Responsibilities
Design and develop scalable data pipelines and infrastructure on Azure; Optimize data storage and retrieval processes; Implement data integration and transformation processes using Azure data services; Monitor and troubleshoot data systems to ensure accuracy and reliability; Stay updated with industry best practices and emerging technologies in data engineering and Azure services.
Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.