Senior Data Engineer
Core
Design and develop scalable data pipelines and Lakehouse solutions on Databricks, focusing on performance tuning, cost optimization, and data governance.
Role type
Senior Data Engineer (Databricks Lakehouse)
Builds
Production data pipelines, Lakehouse solutions, and monitoring automation
Domain
Data Engineering / Cloud Data Platforms
Deliverable
production ML models | product features
Required skills
Databricks, Delta Lake, Unity Catalog, Spark performance tuning, Python (PySpark), SQL, CI/CD, DevOps, observability tooling
Preferred skills
Databricks-native AI capabilities, agentic frameworks, Serverless Compute, DBSQL performance tuning, Infrastructure-as-Code
Technologies
Databricks, Delta Lake, Unity Catalog, PySpark, SQL
Responsibilities
Design and develop scalable data pipelines and Lakehouse solutions; Build and tune Databricks workloads for performance and cost; Implement best practices for partitioning, clustering, and workload isolation; Track performance trends and resolve long-running loads; Design and operationalize Unity Catalog for data governance; Build monitoring and self-healing automation using Databricks-native AI; Contribute to CI/CD workflows for Databricks assets
Seniority
Senior, hands-on IC
