PIPELINE - L5 Principal Software Engineer
Core
Design and implement data platform capabilities for event ingestion, stream processing, batch orchestration, and lakehouse/warehouse patterns.
Role type
Principal Software Engineer (Data Platform)
Builds
Scalable data platforms, data abstractions, and governance frameworks for product, analytics, and ML teams.
Domain
Data Engineering / Distributed Systems
Deliverable
production ML models
Required skills
Distributed data systems, event ingestion, CDC, stream processing, batch orchestration, lakehouse patterns, catalog and lineage, SLO-driven operations, system profiling and tuning, FinOps, AI/automation for data workflows, technical mentorship, ADR/RFC authoring.
Preferred skills
Regional isolation and replication, privacy-by-design, data governance in regulated contexts, standardized ingestion paths, cost optimization, AI-augmented data operations.
Technologies
Kafka, Pub/Sub, Flink, Spark, Beam, Airflow, Dagster, Iceberg, Delta, Hudi, Snowflake, BigQuery, object storage.
Responsibilities
Design and implement data platform capabilities; define and uphold data freshness, availability, and correctness SLOs; author ADRs and RFCs; profile and tune systems for performance and cost; partner with product, analytics, and ML teams; mentor Staff and Senior engineers; apply AI and automation to data workflows.
Seniority
Principal, hands-on IC with mentorship