Sr. Databricks Security Engineer
Core
Designing and implementing a comprehensive security framework for Databricks on Azure and/or AWS to secure enterprise data and AI platform workloads including financial analytics and machine learning.
Role type
Senior Databricks Security Engineer
Builds
Security architecture, governance policies, and compliance controls for the Lakehouse platform
Domain
Financial services, Cloud Data Platforms (Azure/AWS), Databricks
Deliverable
production ML models | infrastructure
Required skills
Databricks platform administration, Unity Catalog, cloud data platform security, PySpark, Python, SQL, data governance frameworks, regulatory compliance standards, MLOps security concepts
Preferred skills
Databricks certifications, Delta Sharing security, model risk management frameworks, Apache Atlas/Ranger
Technologies
Databricks, Unity Catalog, Azure AD, ADLS Gen2, VNet, S3, IAM, OAuth 2.0, OIDC, Delta Lake
Responsibilities
Design and govern Databricks security architecture including Unity Catalog and cluster policies; Implement fine-grained access control, data lineage, and attribute-based access control; Manage workspace security including network configurations and secrets management; Implement audit logging for threat detection and compliance; Govern service principal lifecycle and authentication integration; Collaborate with engineering teams to embed security reviews in pipelines; Lead data classification and protection initiatives; Drive compliance alignment for workloads; Develop security baselines and configuration-as-code templates; Perform security assessments of ML models for adversarial risks; Act as internal SME for Databricks security; Support third-party security audits.
Seniority
Senior, hands-on IC