Data Engineer
Core
Design, develop, and support enterprise-scale data pipelines, integrations, and the Enterprise Data Lake using Azure cloud technologies.
Role type
Senior hands-on Data Engineer
Builds
Enterprise data platforms, ETL/ELT solutions, and data ingestion/transformation processes
Domain
Financial services / Cloud data engineering
Deliverable
production ML models
Required skills
Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Spark/PySpark, Python, SQL, Event Hubs, Change Data Capture (CDC), database management, cloud-based data solutions, unit testing, system integration testing
Preferred skills
Financial services domain knowledge, data governance, data product concepts, AI/Generative AI solutions
Technologies
Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Spark, PySpark, Python, SQL, Event Hubs, Debezium
Responsibilities
Design and build ETL/ELT solutions; maintain Enterprise Data Lake; monitor and optimize pipeline performance; troubleshoot production incidents; develop technical documentation; participate in Agile delivery ceremonies
Seniority
Senior, hands-on IC