Senior Big Data Infrastructure Engineer
Core
Own and lead the big data infrastructure for the international contour, deploying and operating core services like HDFS, S3-compatible storage, and Iceberg.
Role type
Senior Big Data Infrastructure Engineer
Builds
Core services of the big data platform (HDFS, S3-compatible object storage, Iceberg)
Domain
Big Data Infrastructure
Deliverable
infrastructure
Required skills
HDFS/Hadoop deployment and operations, S3-compatible object storage, Apache Iceberg, monitoring and alerting setup
Preferred skills
Trino, Kafka, Flink, Iceberg REST catalogs, resource quotas and cost allocation, AI tools
Technologies
HDFS, Hadoop, Apache Ozone, MinIO, Apache Iceberg, Lakekeeper, Gravitino, Trino, Kafka, Flink
Responsibilities
Deploy, upgrade, and operate core platform services; run infrastructure pilots for dataset fragmentation; introduce compute and storage quotas; migrate Iceberg catalogs; rebuild monitoring and alerting
Seniority
Senior, hands-on IC
