Data Engineer II - ETL Pipeline
Core
Design and develop advanced data pipeline solutions to support Analytic Developers within the Data as a Service team.
Role type
Senior Data Engineer (ETL & Data Warehousing)
Builds
Batch and real-time data pipelines, data warehousing solutions, and analytics platforms.
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Data warehousing, Azure Data Lake Ingestion, Curation, Azure Data Bricks, Azure Data Factory, Python, SQL Server, DevOps (Git Hub, Jenkins, Azure Pipelines), Data visualization (PowerBI, Tableau), Agile methodologies, L3 Production Support
Preferred skills
Hands-on experience with MS SQL Server or similar RDBMS
Technologies
Azure Data Bricks, Azure Data Factory, Python, MS SQL Server, PowerBI, Tableau, Git Hub, Jenkins, Azure Pipelines, JIRA
Responsibilities
Lead proof-of-concept solutions and prototyping for new patterns, improve data management processes for acquiring and transforming massive volumes of data, ensure compliance with data privacy standards, lead developing new solutions for batch and real-time data use cases, ensure ETL pipelines are produced with highest quality standards, coordinate stakeholders and business partners, manage project workload and development standards, oversee code review, provide L3 Production Support
Seniority
Senior, hands-on IC