Databricks - Data Engineer (IC)
Core
Design, develop, and optimize scalable data pipelines and ETL/ELT processes on the Databricks Lakehouse Platform to power business intelligence, reporting, and AI-driven initiatives.
Role type
Senior IC Data Engineer (Databricks/Azure)
Builds
Scalable data pipelines, data models, and high-quality data products for enterprise analytics and AI.
Domain
Cloud data engineering on Microsoft Azure
Deliverable
production ML models | product features
Required skills
Databricks, PySpark, Python, SQL, Azure, Data Modeling, Data Quality, Git, CI/CD
Preferred skills
Delta Lake, Unity Catalog, Azure Data Factory, .NET/C#, Docker, Kubernetes, Power BI
Technologies
Databricks, Azure, PySpark, Delta Lake, Unity Catalog, Azure Data Factory, Git, Azure DevOps, .NET, C#, Docker, Kubernetes, Power BI (via careerplan.io/jobs/R1768127-databricks-data-engineer-ic-at-cnx)
Responsibilities
Design and maintain scalable data pipelines; Build and optimize ETL/ELT processes; Develop robust data models and quality frameworks; Support advanced analytics and AI initiatives; Collaborate with stakeholders to translate requirements; Troubleshoot platform issues and optimize performance; Contribute to CI/CD and infrastructure-as-code.
Seniority
Senior, hands-on IC