Data Engineer Consultant
Core
Design, build, and maintain scalable data platforms and ETL/ELT pipelines on Microsoft Azure to support data analytics and decision-making for a large HMO.
Role type
Senior Data Engineer (Cloud/ETL)
Builds
End-to-end data solutions, data warehouses, data lakes, and APIs on Microsoft Azure.
Domain
Healthcare / Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Azure Data Factory, Databricks (PySpark, Spark SQL, Delta Lake), Azure Data Lake, SQL, CI/CD, data modeling, data quality validation, cloud security (RBAC, encryption), pipeline orchestration, cost optimization.
Preferred skills
Experience with modern data architecture patterns, knowledge of healthcare data governance, familiarity with Azure DevOps.
Technologies
Microsoft Azure, Azure Databricks, Azure Data Factory, Azure Data Lake, PySpark, Delta Lake, Azure DevOps.
Responsibilities
Design and build scalable data platforms on Azure; develop and optimize ETL/ELT pipelines; implement data transformation logic using Databricks; manage structured and unstructured data in cloud storage; ensure data quality and pipeline reliability; apply cloud security best practices; automate deployments and monitoring; collaborate with analysts and scientists to translate business needs into technical solutions.
Seniority
Senior, hands-on IC
