Senior Data Engineer (Databricks)
Core
Design and develop scalable cloud-based data architectures, build reusable data ingestion frameworks, and optimize data pipelines within a Databricks and Azure environment.
Role type
Senior Data Engineer (Databricks)
Builds
Scalable cloud data platforms, reusable data ingestion frameworks, and optimized data pipelines.
Domain
Cloud Data Engineering, Big Data, Microsoft Azure
Required skills
Databricks, Apache Spark (PySpark), Microsoft Azure, SQL, Python, Data Streaming (Azure Event Hubs, Kafka), Dimensional Modeling, Data Warehouse Design, Cloud-Native Architecture
Preferred skills
Databricks Lakehouse Architecture, Delta Lake, Unity Catalog, Databricks Workflows, Data Governance, DataOps
Technologies
Databricks, Apache Spark, PySpark, Microsoft Azure, Azure Event Hubs, Kafka, Delta Lake, Unity Catalog
Responsibilities
Design and develop scalable cloud-based data architectures; Lead the implementation of data engineering best practices using Databricks and Apache Spark; Develop reusable data ingestion frameworks; Build, maintain, and optimize data pipelines; Provide technical guidance and mentorship to portfolio teams; Implement data governance, cataloging, and quality monitoring practices; Collaborate with Data Architects, Data Scientists, and business areas.
Seniority
Senior, hands-on IC