Senior Data Engineer
Core
Building, optimizing, and maintaining data pipelines and ETL processes within Databricks to support data-driven decision-making across business units.
Role type
Senior Data Engineer
Builds
Robust data solutions covering Bronze, Silver, and Gold medallion layers
Domain
Energy and utilities infrastructure
Deliverable
production ML models
Required skills
Databricks, Apache Airflow, DBT core, Spark, Python, SQL, data extraction, transformation, and integration
Preferred skills
CI/CD (GitLab), Terraform, RBAC, real-time streaming
Technologies
Databricks, Apache Airflow, DBT, Spark, PySpark, Delta Lake, GitLab, Terraform
Responsibilities
Develop efficient data models and processing pipelines, orchestrate data workflows, manage dependencies, collaborate with line-of-business teams to understand data requirements, ensure data integrity and performance
Seniority
Senior, hands-on IC