Senior Staff Data Platform Engineer - Kafka - Apache Iceberg - Apache Spark
Core
Architect and build high-performance distributed data platform components, focusing on data ingestion pipelines, Data Lake architectures, and streaming systems for massive-scale data volume and throughput.
Role type
Senior Staff IC Data Platform Engineer (Kafka, Spark, Iceberg)
Builds
Scalable data ingestion solutions, full-stack Data Lake solutions, foundational libraries, and distributed platform components.
Domain
Data Engineering / Distributed Systems / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems architecture, Java (JVM internals, tuning, profiling), Kafka (high-scale clusters, HA), Apache Spark (batch & streaming), Apache Iceberg, Apache Flink, stream processing, data formats (Parquet, ORC, Avro), relational databases (Oracle, MySQL, PostgreSQL), DevOps.
Preferred skills
AI integration in engineering workflows, automating workflows, reasoning about AI impact on software/infrastructure.
Responsibilities
Architect and design high-performance distributed systems; build data ingestion solutions; deliver clean, modular, reusable code; provide technical leadership for complex projects; troubleshoot production issues; research and adopt new technologies.
Seniority
Senior Staff (IC5), hands-on engineering with significant leadership.