Senior Data Engineer - Data Experience
Core
Designing and building data pipelines to bring vendor datasets into a centralized data platform for trading, research, and back-office purposes.
Role type
Senior Data Engineer
Builds
Vendor ingestion pipelines, data governance processes, and monitoring software for the Unified Data Platform.
Domain
Financial Trading / Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Java, Python, data modeling, data pipeline orchestration, data migration, data quality control
Preferred skills
Batch and streaming data ecosystems, data processing technologies (Flink, Spark, Polars, Dask), data storage technologies (S3, RDBMS, NoSQL, Delta/Iceberg, Cassandra, Clickhouse, Kafka), data formats (Arrow, Parquet, Protobuf/gRPC, Avro, Thrift, JSON), Kubernetes, Argo Workflows, Airflow, Prefect, Dagster
Technologies
Flink, Spark, Polars, Dask, S3, RDBMS, NoSQL, Delta, Iceberg, Cassandra, Clickhouse, Kafka, Arrow, Parquet, Protobuf, gRPC, Avro, Thrift, JSON, Kubernetes, Argo Workflows, Airflow, Prefect, Dagster
Responsibilities
Model, build, and manage data products on the Unified Data Platform; Design data governance processes for discovery, cost-sharing, usage tracking, access controls, and quality control; Continually monitor data ingestion pipelines and data quality; Own technical aspects of vendor ingestion pipelines; Rapidly respond to user requests to identify platform gaps and self-service opportunities.
Seniority
Senior, hands-on IC
