Senior Data Engineer - Databricks
Core
Own Databricks production support, pipeline optimization, and multi-tenant data platform architecture for enterprise customers.
Role type
Senior IC data engineer (Databricks/Spark)
Builds
Production-grade data pipelines, Delta Lake architecture, and multi-tenant data isolation patterns
Domain
Cloud data engineering (Azure/AWS), multi-tenant SaaS, enterprise data platforms
Deliverable
production ML models | product features | infrastructure
Required skills
PySpark, SQL, Python, Delta Lake, pipeline performance tuning, legacy ETL migration, multi-tenant architecture, data governance, CI/CD
Preferred skills
Serverless compute optimization, ML feature engineering, Infrastructure as Code, Microsoft SQL Server
Technologies
Databricks, Apache Spark, Azure, AWS, Delta Lake, PostgreSQL, SSIS, Informatica
Responsibilities
Monitor and respond to production data flow incidents, optimize Databricks compute costs and throughput, migrate legacy ETL pipelines to Databricks, design Delta Lake schema and partitioning strategies, enforce data security and compliance, support customer onboarding with tenant pipeline provisioning, implement data quality observability, maintain technical documentation and runbooks, apply CI/CD practices to pipeline delivery
Seniority
Senior, hands-on IC
