Databricks Engineer - Data Engineer III
Core
Develop and optimize data pipelines, apply Medallion architecture, and manage data security and lineage within the Databricks Lakehouse platform for government and public sector clients.
Role type
Data Engineer III (IC)
Builds
Data pipelines and workflows on the Databricks Lakehouse platform
Domain
Government & Public Services / Data Engineering
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Databricks, Medallion architecture, Unity Catalog, CI/CD, performance tuning
Preferred skills
Medallion architecture, Unity Catalog security, CI/CD implementation, performance tuning
Technologies
Databricks, Python, PySpark, SQL, Unity Catalog
Responsibilities
Develop and optimize data pipelines, Apply Medallion architecture patterns, Perform performance tuning for Databricks workloads, Configure row-level and column-level security, Implement CI/CD and testing processes
Seniority
Mid-level, hands-on IC
