Senior Data Engineer - Databricks
Core
Own Databricks production support, pipeline optimization, and multi-tenant data platform architecture for enterprise customers.
Role type
Senior Data Engineer (Databricks)
Builds
Production-grade data pipelines, Delta Lake architectures, and multi-tenant data isolation patterns for ERP/CRM data.
Domain
Cloud Data Engineering (Azure/AWS)
Deliverable
production ML models | product features | infrastructure
Required skills
Databricks, Apache Spark, PySpark, SQL, Python, Delta Lake, PostgreSQL, ETL/ELT migration, CI/CD, data governance, multi-tenant architecture
Preferred skills
Serverless compute optimization, Infrastructure as Code (IaC), ML feature engineering, Microsoft SQL Server, Databricks certification
Technologies
Databricks, Apache Spark, PySpark, SQL, Python, Delta Lake, PostgreSQL, Azure, AWS, SSIS, Informatica
Responsibilities
Own Databricks production support including monitoring, alerting, and incident response; Migrate legacy ETL/ELT pipelines to Databricks; Design and build high-performance pipelines for ERP/CRM data; Enforce data security and multi-tenant isolation patterns; Implement data quality monitoring and observability; Apply CI/CD best practices to pipeline development.
Seniority
Senior, hands-on IC
