Senior Data Engineer - Data Platform
Core
Design, develop, and operate scalable data pipelines and data products on a modern Azure-based data platform.
Role type
Senior IC data engineer (data platform)
Builds
Scalable data pipelines, data products, and data models
Domain
Enterprise data engineering on Microsoft Azure
Deliverable
production ML models
Required skills
Databricks, SQL, Python, Apache Spark, dbt Core, Data Vault 2.0, dimensional modeling, CI/CD, Git, Microsoft Azure
Preferred skills
Health insurance sector experience, SAFe methodology
Technologies
Databricks, Azure, dbt Core, Apache Spark, Python, SQL
Responsibilities
Develop and maintain modern data platforms on Databricks; Design and optimize scalable data pipelines; Implement robust data models using Data Vault 2.0; Manage data transformations with dbt Core; Establish data quality and validation processes; Ensure cost-efficient operation of data solutions in Azure; Collaborate with agile teams to deliver data engineering solutions; Automate development and deployment workflows using CI/CD.
Seniority
Senior, hands-on IC