[Job-32192] Senior Data Engineer - Databricks
Core
Design, develop, and maintain large-scale data pipelines in Databricks using Medallion Architecture to integrate and transform data from diverse sources.
Role type
Senior Data Engineer (Databricks)
Builds
Robust data pipelines and data warehousing solutions
Domain
Data Engineering, Cloud Data Platforms
Deliverable
production ML models
Required skills
PySpark, Delta Lake, SQL, Python, Git, CI/CD, ETL/ELT, Cloud platforms (AWS/Azure/GCP)
Preferred skills
Data quality frameworks (Great Expectations, Soda, dbt), Power BI integration, Data contracts
Technologies
Databricks, PySpark, Delta Lake, AWS, Azure, GCP, Git, CI/CD
Responsibilities
Develop and maintain data pipelines; Integrate data from APIs, databases, and files; Collaborate with business and analytics teams; Ensure data quality, reliability, security, and governance; Follow DataOps practices; Document processes and best practices
Seniority
Senior, hands-on IC