Data Engineer
Hybrid
Core
Build, deploy, and operate production Spark data pipelines on Databricks to power analytics products.
Role type
Mid-level to senior individual contributor data engineer
Builds
Production Spark data pipelines on Databricks
Domain
Enterprise SaaS / Data Engineering
Deliverable
production ML models
Required skills
Spark, Databricks, SQL, Data pipeline reliability, Observability, Performance tuning, Cost optimization, Batch processing, Stream processing
Preferred skills
Python, AWS, Logical replication, RAG pipelines, Platform administration
Responsibilities
Build and deploy production Spark pipelines; Partner with product teams on data requirements; Set up monitoring and observability; Diagnose performance and cost issues; Recommend standards for scaling pipelines.