Databricks Data Engineer / Developer (PL 866)
Core
Design, develop, and maintain scalable data pipelines and ETL/ELT processes within an Enterprise Data Platform (EDP) to support enterprise reporting, analytics, and AI initiatives.
Role type
Senior Data Engineer (Databricks)
Builds
Scalable data pipelines, ETL/ELT processes, and modern cloud-based data solutions
Domain
Enterprise Data Platforms, Cloud Data Architecture, Data Modernization
Required skills
Databricks, ETL/ELT, Data Engineering, Data Integration, SQL, Python, Data Warehousing, Data Lakehouse concepts, Cloud platforms, Agile delivery
Preferred skills
Azure Data Services, Delta Lake, Spark/PySpark, Azure Synapse, Data Governance, CI/CD, AI/GenAI exposure
Technologies
Databricks, Azure Data Factory, Delta Lake, Spark, PySpark, Azure Synapse, SQL, Python
Responsibilities
Design and develop data pipelines; Build and optimize ETL/ELT processes; Develop scalable data solutions using Databricks; Support migration from HANA environments; Collaborate with Data Architects; Ensure data quality and performance; Troubleshoot data issues; Participate in code reviews and deployment; Work with business teams to understand requirements.
Seniority
Mid-Senior, hands-on IC