Databricks Data Engineer
Core
Design, build, and maintain scalable data pipelines and advanced analytics/AI solutions using Databricks for client projects.
Role type
Databricks Data Engineer
Builds
Scalable data pipelines, batch and streaming data workflows, curated data products
Domain
Cloud data engineering, AI & Data
Deliverable
production ML models | product features
Required skills
Python, PySpark, SQL, Databricks, Spark, Delta Lake, Unity Catalog, data modeling, data warehousing, data quality validation, cloud platforms (Azure/AWS/GCP)
Preferred skills
Databricks certifications, CI/CD tools, Terraform, streaming frameworks, medallion architecture design
Technologies
Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Azure, AWS, GCP
Responsibilities
Design and build scalable data pipelines; Develop batch and streaming data workflows; Write and optimize Python/PySpark/SQL code; Troubleshoot pipeline failures and performance issues; Translate business requirements into engineering designs; Perform data validation and quality checks; Document pipelines and engineering decisions
Seniority
Mid-Senior, hands-on IC
