Databricks Data Engineer

## About the role E Source is seeking a Databricks Data Engineer to join the Machine Learning Engineering team. This role focuses on designing, building, and maintaining scalable, reliable, and secure data pipelines, infrastructure, and systems that support consulting services and software-as-a-service (SaaS) solutions. You will work closely with machine learning engineers, software engineers, data scientists, and data analysts to deliver data products for clients and to support internal data practices. ## About the company E Source is a research, data/analytics, and technology focused professional services firm focused exclusively on the utility industry in the US and Canada. We help utilities target and serve their customers more effectively, enhance and optimize their grid, and leverage operating best practices and technologies to manage their business more effectively. Headquartered in Texas, we have 450+ employees across the US and Canada. Learn more at www.esource.com. ## Responsibilities - Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL - Collaborate with cross-functional teams to translate business requirements into technical solutions - Provide technical guidance and mentorship to junior data engineers - Develop and implement data engineering standards and best practices - Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability - Research industry trends and evaluate new data technologies - Build and maintain data lakes to support analytics and business intelligence - Manage the software development life cycle and DevOps activities - Partner with data scientists and analysts to deliver effective data solutions - Develop data validation and data analysis tools ## Requirements - Bachelor's degree in computer science, information technology, or a related field - Five or more years of experience in data engineering or a related role - Expert proficiency in Python, SQL, Databricks, and Spark - Experience building cloud-based data pipelines in AWS - Knowledge of data governance, security, privacy, and retention practices - Strong communication, collaboration, and problem-solving skills - Experience working in agile environments using tools such as Jira - Proficiency with Git, Docker, and CI tools such as Jenkins - Passion for data and continuous improvement ## Nice to have - Ability to work independently and proactively - Experience optimizing ETL workflows in Databricks - Knowledge of data lineage and data quality practices - Experience supporting data science and machine learning solutions - Prior experience in the energy or utility industry - Master's degree in a relevant STEM field ## What we offer - Excellent insurance options, including medical, dental, and vision plans; company-paid life insurance; company-paid long- and short-term disability insurance; medical and dependent-care flexible spending plans, and paid parental leave. - A flexible time off (FTO) policy that provides paid time away from work, approved by your manager, while ensuring business needs, workload commitments, and appropriate coverage are maintained. - A 401(k)/RRSP plan with a 3% employer match. ## Location and Eligibility - This role will be 100% remote, with infrequent travel (generally 1–2 times per year). - Applicants must be authorized to work for any employer in the US. We're unable to sponsor or take over sponsorship of employment visas at this time. ## EEO Statement All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. ## Employee Resources Employees of E Source are encouraged to apply. To foster a positive work environment and company culture, we support our employees in their career growth at E Source. If you are interested in similar job opportunities in the future, visit the E Source careers page for a listing of all open positions and contact Human Resources. ## Security Notice We contact applicants directly via email using only our designated company email addresses with the domain of @esource.com. Please do not provide personal information to anyone over email and be wary of other accounts impersonating businesses. #LI-Remote