Senior Software Engineer II
Core
Own the end-to-end architecture, strategy, and operational maturity of the Databricks Lakehouse platform, including AI-native capabilities and governance.
Role type
Senior IC data platform architect
Builds
Production-grade, large-scale, multi-tenant Databricks Data Platform with AI/GenAI pipelines
Domain
Data engineering, distributed systems, cloud infrastructure
Deliverable
production ML models | infrastructure
Required skills
Databricks platform architecture, Unity Catalog governance, Delta Lake/Delta Live Tables, Apache Spark (batch/streaming), Python, SQL, Terraform, CI/CD, cost optimization, AI/GenAI pipeline design
Preferred skills
Databricks Certified Data Engineer Professional, Databricks Certified Platform Architect, agentic engineering practices
Technologies
Databricks, Unity Catalog, Delta Lake, Delta Live Tables, Apache Spark, Terraform, Databricks Asset Bundles, dbt
Responsibilities
Design workspace topology, cluster policies, and multi-cloud deployment patterns; Define and enforce Unity Catalog governance; Establish data engineering standards for Delta Lake and medallion architecture; Industrialize platform provisioning and pipeline deployment; Own Databricks cost transparency and optimization; Architect AI-native capabilities like feature stores and vector search; Lead a Databricks community of practice
Seniority
Senior, hands-on IC
