Data Engineer Databricks senior H/F
Core
Design, develop, and maintain robust data architectures for collecting, storing, transforming, and delivering reliable data.
Role type
Senior Data Engineer
Builds
Data Lake / Data Warehouse platforms and data pipelines
Domain
Data Engineering, Cloud Data Platforms
Deliverable
production ML models
Required skills
Python, Scala, Spark/Pyspark, Databricks, SQL, ETL/ELT, Git/CI/CD, Containerization, Serverless, Data Modeling
Preferred skills
Data Lake/Warehouse architecture, Performance optimization, Data Governance, Automation, Technical documentation
Technologies
Azure Data Factory, Azure Functions, AWS Lambda, Power BI
Responsibilities
Design and evolve data architectures, Develop and maintain data pipelines, Automate and industrialize data flows, Optimize processing performance, Administer and monitor data platforms, Provide technical support to users and integration teams
Seniority
Senior, hands-on IC