Senior Consultant, Data Engineer (Databricks Experience)
Core
Design, build, and maintain scalable data pipelines and ETL processes for clients using Databricks and cloud platforms.
Role type
Senior IC data engineer
Builds
Scalable data infrastructure and automated CI/CD pipelines for client data modernization
Domain
Data engineering and DevOps in cloud environments
Deliverable
production ML models
Required skills
Databricks, Jenkins, Terraform, SQL, Python, Scala, data modeling (3NF, Dimensional, Data Vault), cloud platforms (AWS, Azure, GCP)
Preferred skills
Master's degree in CS/Engineering
Technologies
Databricks, Jenkins, Terraform, AWS, Azure, Google Cloud Platform
Responsibilities
Design and maintain scalable data pipelines and ETL processes; Implement CI/CD pipelines for infrastructure automation; Develop and implement data models based on business requirements; Optimize data processing and storage performance; Implement data quality checks and monitoring; Mentor junior team members
Seniority
Senior, hands-on IC