Senior Databricks Data Engineer
Core
Senior Databricks Data Engineer leading discovery workshops, translating business requirements into technical designs, and building optimized lakehouse architectures on Databricks for clients.
Role type
Senior IC Databricks Data Engineer (Consulting)
Builds
Production data pipelines, lakehouse architectures (Delta Lake, Unity Catalog), and data governance frameworks
Domain
Data Engineering / Cloud Data Platforms (Azure/AWS)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
PySpark, SQL, Python, Databricks (Delta Lake, Medallion Architecture), Azure/AWS Cloud, Git/CI/CD, Stakeholder Elicitation, Requirements Documentation, Technical Design, Scope Management
Preferred skills
Databricks Certification, Unity Catalog, Lakeflow/Delta Live Tables, Terraform, dbt, Airflow, Power BI/Tableau, MLflow, Consulting/Professional Services, Energy/Utilities Industry
Technologies
Databricks, PySpark, SQL, Python, Azure, AWS, Git, Terraform, dbt, Airflow, MLflow, Unity Catalog, Delta Lake
Responsibilities
Lead discovery sessions and requirements workshops with stakeholders; Translate business issues into technical designs; Design and optimize data pipelines on Databricks; Migrate legacy warehouses to Databricks; Set up data governance and lineage; Mentor junior engineers
Seniority
Senior, hands-on IC with client-facing responsibilities
