Databricks Data Engineer
Core
Design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems to support consulting services and SaaS solutions for the utility industry.
Role type
Senior IC data engineer (cloud/data platform)
Builds
Data lakes, data pipelines, and infrastructure for analytics and business intelligence
Domain
Utility industry + cloud data engineering
Required skills
Python, SQL, Databricks, Spark, AWS, PostgreSQL, Git, Docker, CI/CD tools
Preferred skills
ETL optimization, data lineage, data quality practices, data science support, utility industry experience
Technologies
AWS, Databricks, Spark, PostgreSQL, Jenkins, Jira, Docker
Responsibilities
Design and develop data pipelines and infrastructure; collaborate with cross-functional teams to translate business requirements; provide technical guidance and mentorship to junior engineers; develop and implement data engineering standards; monitor and troubleshoot pipelines for data quality; research industry trends and evaluate new technologies; manage SDLC and DevOps activities; build data validation and analysis tools
Seniority
Senior, hands-on IC