CareerPlanSign in

Member of Technical Staff - Engineering Lead, Data Platform

San Francisco, CA💼 Full-time🗓 2026-08-27 → 2026-09-25

Core

Build and operate the core data systems and pipelines powering research, training, and production environments for open-weight AI systems.

Role type

Staff/Principal Engineering Lead, Data Platform

Builds

Trusted data backbone, ingestion, processing, and orchestration systems for high-velocity AI experimentation

Domain

Artificial Intelligence / Data Engineering

Deliverable

production ML models | infrastructure

Required skills

Data engineering at scale, team leadership, technical direction, system design, cost optimization, data quality governance

Preferred skills

Building systems from zero, high-agency execution, cross-functional collaboration

Technologies

Spark, Flink, Beam, Airflow, Dagster, Kafka, PubSub, Parquet, Iceberg, Delta Lake, BigQuery, Snowflake, Great Expectations

Responsibilities

Build and mentor a team of ~10 data platform engineers; guide technical direction for ingestion, orchestration, and scalable compute/storage; enable high-velocity experimentation with unified data layer; establish data quality and lineage signals; optimize cost and performance; stay hands-on with architecture and code

Seniority

Staff/Principal, hands-on IC with leadership responsibilities

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.