Data Engineer (Databricks)
Core
Designing, building, and maintaining scalable data pipelines (ETL/ELT) and data warehouse architectures on Azure/Databricks.
Role type
Senior Data Engineer (Databricks/Azure)
Builds
Scalable data pipelines, data lakes, and data warehouse architectures
Domain
Cloud Data Engineering (Azure, Databricks)
Deliverable
production ML models | infrastructure
Required skills
ETL/ELT pipeline design, data warehouse architecture, distributed computing systems, data modeling (dimensional, star schemas, data vault), relational and non-relational database design, stream and batch processing, pipeline orchestration, cloud infrastructure, data security and governance, version control, CI/CD
Preferred skills
AI tooling for workflow automation and process optimization
Technologies
Azure, Databricks (Asset Bundles, Unity Catalog), Advanced SQL, DaaS, Data Contracts
Responsibilities
Design and implement scalable data pipelines and data lake architectures; optimize relational and non-relational databases; manage distributed computing systems for large-scale datasets; ensure data quality, accuracy, and system reliability; bridge gaps between software engineers and data consumers
Seniority
Senior, hands-on IC