Senior Data Engineer - Vice President - Python Development
Core
Design and build the data foundation for greenfield Generative AI products in Markets, enabling low-latency retrieval for production AI applications.
Role type
Senior IC Data Engineer (Generative AI)
Builds
Production-grade data pipelines, serving layers, and curated datasets for Generative AI products
Domain
Financial Markets / Generative AI
Deliverable
production ML models
Required skills
Python, PostgreSQL, SQL, data modelling, indexing, partitioning, query optimisation, ETL/ELT architecture, data quality controls, CI/CD, Kubernetes/OpenShift
Preferred skills
Workflow orchestration (Airflow/Dagster/Prefect), Generative AI/retrieval architectures, financial instruments knowledge, temporal/reference data
Technologies
Python, pandas, PyArrow, SQLAlchemy, NumPy, Apache Parquet, Apache Spark, Dask, Polars, PostgreSQL
Responsibilities
Design scalable Python pipelines for billions of records; build high-performance serving layers; optimise storage and query performance; establish data quality and lineage controls; contribute to architecture and engineering standards; build automated tests and CI/CD pipelines
Seniority
Senior, hands-on IC
