Databricks Data Engineer (Data & AI)
Core
Design, build, and maintain scalable data and AI solutions using Databricks Lakehouse architectures, from ingestion to production support.
Role type
Senior IC Databricks Data Engineer
Builds
Scalable data and AI solutions, Lakehouse architectures, and data pipelines for reporting, analytics, and Generative AI.
Domain
Cloud Data Engineering & AI
Deliverable
production ML models
Required skills
Databricks, Lakehouse architecture, ELT/ETL, data modeling, batch/streaming pipelines, orchestration (Lakeflow/Airflow/ADF), CI/CD, Python, Terraform
Preferred skills
Generative AI, MLOps, Databricks Declarative Automation Bundles, Databricks certifications
Technologies
Databricks, Lakeflow, Azure Data Factory, Airflow, Python, Terraform, Genie Code, GitHub Copilot
Responsibilities
Design and implement Lakehouse architectures; Build dimensional and feature-ready data models; Develop and maintain integrations with cloud platforms and APIs; Implement automated CI/CD pipelines; Optimize Databricks workloads for performance and cost; Troubleshoot complex platform issues; Leverage AI tools to accelerate development.
Seniority
Senior, hands-on IC