CareerPlan

Data Engineer

San FranciscoFull-time2026-10-16 → 2026-11-20
Hybrid

Core

Build, deploy, and operate production Spark data pipelines on Databricks to power analytics products.

Role type

Mid-level to senior individual contributor data engineer

Builds

Production Spark data pipelines on Databricks

Domain

Enterprise SaaS / Data Engineering

Deliverable

production ML models

Required skills

Spark, Databricks, SQL, Data pipeline reliability, Observability, Performance tuning, Cost optimization, Batch processing, Stream processing

Preferred skills

Python, AWS, Logical replication, RAG pipelines, Platform administration

Responsibilities

Build and deploy production Spark pipelines; Partner with product teams on data requirements; Set up monitoring and observability; Diagnose performance and cost issues; Recommend standards for scaling pipelines.