Data Engineer, Data Platform
Core
Design, build, and optimize a petabyte-scale data platform and data lake using cloud-native technologies to support high-performance data workloads and massive queries for trading teams.
Role type
Senior IC data platform engineer
Builds
Petabyte-scale data lake, scalable cloud infrastructure, and robust data environments
Domain
Financial services / Cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Cloud-native technologies, AWS (S3, EKS, Glue, Airflow, Trino, Parquet), Python, SQL/DDLs, Linux/Unix, CI/CD pipelines, Data Lake/Warehouse architecture
Preferred skills
Apache Iceberg, Container experience, Redshift optimization
Technologies
AWS S3, EKS, Glue, Airflow, Trino, Parquet, Redshift, Apache Iceberg
Responsibilities
Design and maintain robust, scalable infrastructure for massive queries; manage and enhance petabyte-scale Data Lake; build automation and CI/CD pipelines; optimize high-performance data workloads
Seniority
Senior, hands-on IC
