Databricks Data Engineer
Core
Design, build, and maintain scalable, reliable, and secure data pipelines, infrastructure, and systems to support consulting services and SaaS solutions for the utility industry.
Role type
Senior Databricks Data Engineer
Builds
Cloud-based data pipelines, data lakes, and data engineering standards for analytics and business intelligence.
Domain
Utility industry / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Databricks, Spark, AWS, Git, Docker, CI/CD tools, data governance, data validation
Preferred skills
ETL workflow optimization, data lineage, data quality practices, data science support, utility industry experience
Technologies
AWS, Databricks, Spark, PostgreSQL, Jira, Jenkins
Responsibilities
Design and develop data pipelines and infrastructure; collaborate with cross-functional teams to translate business requirements; provide technical guidance and mentorship to junior engineers; monitor and troubleshoot pipelines for data quality; research industry trends and evaluate new technologies; manage software development life cycle and DevOps activities; develop data validation and analysis tools.
Seniority
Senior, hands-on IC
