Senior Data Engineer, Unified Platform
Core
Designing and building data pipelines to bring vendor datasets into a unified platform for trading, research, and back-office purposes.
Role type
Senior IC data engineer (trading infrastructure)
Builds
Centralized data pipelines, data products, and ingestion infrastructure for global trading strategies
Domain
Financial services / High-frequency trading / Data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Java or Python, data modeling, batch and streaming data ecosystems, data pipeline orchestration, data migration, data quality control
Preferred skills
Experience with Flink, Spark, Polars, Dask, S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON, Kubernetes, Argo Workflows, Airflow, Prefect, Dagster
Technologies
Flink, Spark, Polars, Dask, S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka, Arrow, Parquet, Protobuf, gRPC, Avro, Thrift, JSON, Kubernetes, Argo Workflows, Airflow, Prefect, Dagster
Responsibilities
Model, build, and manage data products on the Unified Data Platform; Design data governance processes for discovery, cost-sharing, usage tracking, access controls, and quality control; Monitor data ingestion pipelines and quality to ensure stability; Own technical aspects of vendor ingestion pipelines and coordinate with relationship managers; Respond to user requests to identify platform gaps and self-service opportunities
Seniority
Senior, hands-on IC