Databricks Engineer
Core
Design, build, and operate data integration and analytics solutions on the Databricks platform to enable data-driven decision-making.
Role type
Senior hands-on IC Databricks Engineer
Builds
Production-ready data integration pipelines, analytics models, and lakehouse architectures
Domain
Insurance / Data Engineering / Cloud (Azure)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Databricks, Delta Lake, Spark, PySpark, SQL, Azure Data Factory, Azure Synapse, Event Hubs, ADLS Gen2, Unity Catalog, Terraform, Bicep, MLflow, CI/CD
Preferred skills
Azure certifications, GenAI integration, AI agents, Power BI integration
Technologies
Databricks, Delta Lake, Spark, PySpark, SQL, Azure Data Factory, Azure Synapse, Event Hubs, Functions, ADLS Gen2, Key Vault, MLflow, Terraform, Bicep, Power BI
Responsibilities
Design and implement data integration solutions; implement batch, incremental, and event-driven ingestion; contribute to data modeling standards (Dimensional, Data Vault, Lakehouse); implement data cataloging, lineage, and quality controls; optimize Databricks performance and cost; monitor and troubleshoot pipelines; support platform modernization and migrations.
Seniority
Senior, hands-on IC