Senior Data Engineer (Databricks)
Core
Lead the development, optimization, and scaling of data solutions using Databricks.
Role type
Senior Data Engineer (Databricks)
Builds
Scalable data pipelines, ETL/ELT processes, and cloud data platform initiatives.
Domain
Data Engineering / Cloud Platforms (Azure/AWS)
Required skills
Databricks, Apache Spark, Delta Lake, Python, SQL, Data Modeling, Distributed Computing, Shell Scripting, CI/CD (GitHub, JFrog Artifactory)
Preferred skills
Cloud platform expertise (Azure or AWS), Data governance and security practices
Technologies
Databricks, Spark, Delta Lake, Python, SQL, Azure, AWS, GitHub, JFrog Artifactory
Responsibilities
Design, build, and maintain scalable data pipelines; Optimize ETL/ELT processes for performance and cost; Implement data quality, governance, and security best practices; Collaborate with stakeholders to define data requirements; Troubleshoot issues across distributed systems; Support cloud platform migration and modernization.
Seniority
Senior, hands-on IC