Core Data Engineer
Core
Architect and guardian of fundamental data products (Security Master, ETF Compositions, market data, trade records) ensuring high-quality, timely data for quantitative trading strategies.
Role type
Senior IC data engineer (financial data)
Builds
Automated data pipelines, reference datasets, quality checks, and shared data foundations for quants and trading desks.
Domain
Financial data engineering / Quantitative trading
Deliverable
production ML models
Required skills
Python, SQL, relational databases, version control, big data solutions, data modeling, data quality practices, observability, stakeholder collaboration
Preferred skills
Financial data (prices, transactions, instruments), point-in-time data, look-ahead/survivorship bias, cloud data stack (Spark, Databricks, dbt, cloud warehouse), Airflow, Kafka, GCP (GKE, Dataproc, BigQuery), Polars, Pandas, Apache Beam, Apache NiFi, trading firm experience, on-call/incident response
Technologies
Python, SQL, Spark, Databricks, dbt, Airflow, Kafka, GCP, Polars, Pandas, Apache Beam, Apache NiFi
Responsibilities
Craft datasets aligned with quant research questions; build and maintain end-to-end data pipelines; design data quality checks and alerts; build shared reference data and instrument identifiers; support critical pipelines across global time zones.
Seniority
Senior, hands-on IC