Senior Data Engineer, Databricks
Core
Design, build, and maintain enterprise data platforms and pipelines on Databricks for a federal government client, supporting analytics, automation, and AI/ML.
Role type
Senior Data Engineer (Databricks Platform Lead)
Builds
Enterprise Databricks workspaces, Unity Catalog metastores, and production data pipelines
Domain
Federal Government / Data Engineering
Deliverable
production ML models
Required skills
Enterprise Databricks deployment, Unity Catalog, Terraform, CI/CD, Delta Lake, Python, SQL, Data Governance
Preferred skills
Databricks certification, FedRAMP, NIST 800-53
Technologies
Databricks, Unity Catalog, Terraform, Python, SQL, Google Cloud Platform
Responsibilities
Deploy and configure enterprise Databricks workspaces with Unity Catalog and cluster policies; Implement data governance in Unity Catalog including row- and column-level security; Build CI/CD and infrastructure-as-code pipelines; Build and support production data pipelines and layered data models; Document platform architecture and brief federal stakeholders
Seniority
Senior, hands-on IC