Databricks Engineer
Core
Design and build Databricks-based data pipelines, data models, and workflows to support sales incentive compensation processes.
Role type
Senior Databricks Data Engineer
Builds
Sales incentive compensation data platform (quota management, attainment calculations, commission processing, payout reporting)
Domain
Sales operations / Finance / Data Engineering
Deliverable
production ML models | product features
Required skills
Databricks (Delta Lake, Delta Live Tables, Unity Catalog, Workflows), Python, Scala, Advanced SQL, ETL/ELT, Data Modeling, Data Orchestration
Preferred skills
Azure/AWS/GCP integration, Azure Data Factory, Kafka, Anaplan, Oracle ICM, Varicent, Databricks certification
Technologies
Databricks, Delta Lake, Unity Catalog, Python, Scala, SQL, Kafka, Azure, AWS, GCP, Azure Data Factory
Responsibilities
Design and build Databricks-based data pipelines and data models; Maintain and optimize Databricks workspaces and automation; Translate business requirements into scalable technical solutions; Partner with Sales Operations and Finance to model incentive plan rules; Test, debug, and troubleshoot data pipelines; Document data models and technical processes; Collaborate with cross-functional teams (Finance, IT, BI)