Senior Data Engineer — Data Platform
Core
Build and operate a next-generation data lakehouse platform (Spark on Kubernetes, Apache Iceberg, AWS Glue) that powers data processing for the entire product, balancing cost and performance while enabling other engineers.
Role type
Senior IC data platform engineer
Builds
A unified data platform (compute, storage, orchestration) and shared frameworks/libraries for data pipelines
Domain
Cloud-native data infrastructure on AWS
Required skills
Spark, Kubernetes, Apache Iceberg, AWS Glue, Airflow, Python, SQL, data modeling, CI/CD, distributed systems
Preferred skills
Apache Iceberg, EMR on EKS, Kafka, GitOps, FinOps, cybersecurity data infrastructure
Technologies
Spark, Kubernetes, Apache Iceberg, AWS Glue, Airflow, Kafka, Python, SQL
Responsibilities
Design and operate Spark-on-Kubernetes compute platform; manage lakehouse storage layer (Iceberg/Glue); build orchestration on Airflow; develop shared frameworks and libraries for data pipelines; optimize cost and performance of data workloads
Seniority
Senior, hands-on IC
