Data Engineer
Core
Building and maintaining data infrastructure for quantitative research and automated trading systems, ensuring high-fidelity data delivery.
Role type
Data Engineer (Quantitative Platform)
Builds
Production-grade data pipelines and automated validation frameworks for market, fundamental, and alternative data.
Domain
Financial markets / Quantitative investment
Deliverable
production ML models
Required skills
Python, ETL/ELT pipeline design, data validation frameworks, S3, Kafka, Airflow, Iceberg
Preferred skills
Financial market knowledge, hierarchical reference data models, Apache Spark, real-time data stream handling, distributed computing
Technologies
Python, S3, Kafka, Airflow, Iceberg, Apache Spark
Responsibilities
Evaluate and integrate complex data products from diverse vendors; Design and optimize robust data pipelines for raw-to-analysis-ready transformation; Engineer automated validation frameworks for data accuracy and integrity; Provide operational support for data pipelines and resolve critical issues; Participate in team rotations and on-call schedules for system resilience.