Senior Staff Data Platform Engineer - Apache Iceberg - Apache Spark
Core
Architect and build large-scale distributed data platform components, focusing on data ingestion pipelines and Data Lake architectures using Apache Iceberg and Spark.
Role type
Senior Staff IC Data Platform Engineer
Builds
Scalable, high-performance data ingestion solutions and foundational libraries for data-in-motion and backend storage systems.
Domain
Enterprise software, distributed systems, data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems architecture, Java (JVM internals, tuning), Kafka/stream processing, Data Lake design, Apache Iceberg, Apache Spark, Parquet/ORC/Avro, DevOps
Preferred skills
AI integration in engineering workflows, schema evolution strategies, fault-tolerant workflow design
Technologies
Apache Iceberg, Apache Spark, Kafka, Java, Parquet, ORC, Avro, PostgreSQL, MySQL, Oracle
Responsibilities
Architect high-performance distributed systems, build data ingestion solutions, design extensible software frameworks, troubleshoot production issues, provide technical leadership, research new technologies
Seniority
Senior Staff (IC5), hands-on IC with significant leadership