Data Engineer
Core
Build and maintain automated data pipelines feeding a Databricks lakehouse for the Investment Division, handling ingestion, transformation, and reverse data flow for financial analytics.
Role type
Senior Data Engineer (Financial Services)
Builds
Automated ingestion pipelines, medallion architecture data layers, security master mappings, and document intelligence ingestion flows.
Domain
Financial Services / Investment Management / Data Engineering
Deliverable
production ML models | product features
Required skills
Python, SQL, PySpark, Delta Live Tables, API integrations, Azure Data Factory, Azure Blob Storage, Azure Functions, document processing (PDF/OCR), data quality monitoring, pipeline optimization.
Preferred skills
Experience with financial data feeds, corporate action processing, medallion architecture implementation.
Technologies
Databricks, Spark, Delta Live Tables, Azure Data Factory, Azure Blob Storage, Azure Functions, Addepar API, Capital IQ API, Canoe, eVestment, Mercer, Outlook Graph API, Nama, UMG DMS, IFM CMMS.
Responsibilities
Build and maintain automated ingestion pipelines from multiple financial data sources; implement medallion architecture (bronze, silver, gold) for data transformation; manage security master mappings and corporate actions; build data quality monitoring frameworks; develop document intelligence ingestion pipelines; manage reverse pipelines pushing model outputs to external systems; optimize pipeline performance and cost.
Seniority
Mid-Senior, hands-on IC
