Senior Databricks Data Engineer
Core
Design, develop, and implement scalable data pipelines and modern data architectures (Medallion, Delta Lake) ensuring data quality and performance.
Role type
Senior Databricks Data Engineer
Builds
Scalable ETL/ELT pipelines, Data Lakehouse architectures, and optimized data sets for analytics and ML.
Domain
Cloud Data Engineering, Big Data, Data Governance
Required skills
Apache Spark, Scala, Python, Cloud Architecture (Azure/AWS/GCP), Batch & Streaming Data Ingestion, Delta Lake, Unity Catalog, CI/CD integration
Preferred skills
Hadoop ecosystem, Data Quality checks, MLflow integration, Power BI data exposure
Technologies
Databricks, Apache Spark, Unity Catalog, MLflow, Power BI, Azure/AWS/GCP
Responsibilities
Design and implement complex ETL/ELT flows; Optimize Delta Lake tables for performance; Configure security and access controls via Unity Catalog; Collaborate with Data Scientists and Power BI developers; Automate workflows and monitor data quality.
Seniority
Senior, hands-on IC