Data Engineer
Core
Designing and maintaining large-scale data engineering solutions for risk, regulatory reporting, and capital management within a financial institution.
Role type
Senior Data Engineer (Financial Services)
Builds
Production-grade ETL/ELT pipelines, data models, and governed data assets for risk and regulatory domains.
Domain
Financial Services / Risk & Regulatory / Big Data
Deliverable
production ML models | product features
Required skills
SQL, Python, PySpark, Azure Databricks, Delta Lake, Azure Synapse, Azure Data Factory, Unity Catalog, ETL/ELT architecture, data modeling, data governance, distributed processing optimization, complex query optimization, risk domain knowledge (Credit Risk, Capital, Stress Testing), regulatory reporting knowledge.
Preferred skills
Model validation, backtesting, monitoring dashboards, DevOps tools (Git, CI/CD), experience with large financial institutions.
Technologies
Azure Databricks, PySpark, Delta Lake, Azure Synapse, Azure Data Factory (ADF), Azure Functions, Unity Catalog, Git, CI/CD.
Responsibilities
Designing independent data solutions, making architectural trade-offs, delivering production-grade systems, configuring and tuning Databricks clusters, implementing data governance and security best practices, collaborating with architects and stakeholders.
Seniority
Senior, hands-on IC
