Databricks Data Engineer
Core
Design, develop, and maintain cloud-based data pipelines, infrastructure, and systems using AWS, Python, Databricks, and Spark to support consulting services, SaaS solutions, and internal data practices.
Role type
Senior IC data engineer (cloud data platforms)
Builds
Data lakes, ETL workflows, and data pipelines for analytics and business intelligence
Domain
Cloud data engineering on AWS
Deliverable
production ML models
Required skills
Python, SQL, Databricks, Apache Spark, AWS, PostgreSQL, Git, Docker, CI/CD tools (Jenkins), data governance, data security, Agile methodologies
Preferred skills
ETL workflow optimization, data lineage, data quality practices, supporting data science/ML solutions, energy or utilities industry experience, advanced STEM degree
Technologies
AWS, Databricks, Spark, PostgreSQL, Docker, Jenkins, Git, JIRA
Responsibilities
Design and maintain data pipelines and infrastructure; mentor junior engineers; establish data engineering standards; monitor and troubleshoot pipelines; research emerging data technologies; partner with data scientists to deliver solutions; develop data validation tools
Seniority
Senior, hands-on IC