Databricks Data Engineer
Core
Design, build, and maintain scalable data pipelines and architectures on the Databricks platform for diverse clients across various industries.
Role type
Senior Databricks Data Engineer
Builds
Robust data pipelines, data lakes, and data warehouses
Domain
Cloud data engineering (Azure/AWS/GCP) and Databricks ecosystem
Deliverable
production ML models | product features
Required skills
Databricks platform expertise, Apache Spark, data pipeline design, data modeling, data quality validation, cloud integration (Azure/AWS/GCP), SQL
Preferred skills
Experience with streaming platforms, Delta Lake, Databricks Workflows, data governance best practices
Technologies
Databricks, Spark, Delta Lake, Azure Data Lake Storage, AWS S3, Google Cloud Storage
Responsibilities
Design and deploy scalable data pipelines; orchestrate complex workflows using Databricks SQL and Workflows; integrate Databricks with cloud storage and compute services; design data models for data lakes and warehouses; implement data quality checks and validation procedures; collaborate with data scientists and business stakeholders to define data requirements.
Seniority
Senior, hands-on IC