Principal Consultant- Databricks
Core
Lead Data Engineer responsible for managing Databricks workspaces, optimizing performance and cost, and administering security and access controls for enterprise clients.
Role type
Senior IC Databricks Platform Engineer
Builds
Secure, optimized, and scalable Databricks environments for global enterprises
Domain
Cloud Data Engineering / Databricks Platform
Deliverable
production ML models | infrastructure
Required skills
Databricks Platform, Unity Catalog, Infrastructure as Code (Terraform), AWS Account Management, S3 Access Management, Cluster and Job Configuration, Security and Privacy Setup, Troubleshooting
Preferred skills
Agile Methodology, Client Relations, Commercial Sales, People Leadership
Technologies
Databricks, AWS, Terraform, CloudFormation, S3, Apache Spark
Responsibilities
Manage Databricks workspaces and AWS account audit logs; Optimize usage for performance and cost; Build infrastructure as code; Administer workspace users, groups, SSO, and access control; Manage S3 access across large user bases; Configure clusters and jobs; Troubleshoot end-user and platform issues; Deliver client presentations and demos
Seniority
Senior, hands-on IC