Senior Data Engineer
Core
Design, build, and operate enterprise-grade Databricks platforms, including architecture, infrastructure-as-code, security, and AI/ML workloads.
Role type
Senior Data Engineer (Platform)
Builds
Self-service data platform patterns, reference architectures, and AI/ML infrastructure on Databricks.
Domain
Cloud Data Engineering / Databricks / AWS
Deliverable
infrastructure
Required skills
Databricks administration, Terraform, CI/CD, Python, PySpark, SQL, FinOps, platform security, distributed systems design, AWS fundamentals
Preferred skills
Databricks Certified Data Engineer Professional, AWS Certified Solutions Architect, compliance-driven platform experience, mentoring experience, platform migration experience, global delivery experience
Technologies
Databricks, Unity Catalog, Lakeflow, MLflow, Delta Lake, PySpark, Terraform, GitHub Actions, AWS (S3, IAM, VPC, KMS)
Responsibilities
Own workspace- and account-level Databricks architecture; Design, build, and review infrastructure-as-code, CI/CD, and observability; Manage Databricks FinOps activities; Implement platform security and governance controls; Enable and operate Databricks capabilities for AI/ML workloads; Own the platform roadmap and mentor engineers
Seniority
Senior, hands-on IC with mentorship