Data Engineer
Core
Designing, developing, and deploying cloud data solutions for risk, regulatory, finance, and compliance projects while leading on-prem to cloud migration.
Role type
Senior IC data engineer (cloud)
Builds
Large-scale batch and real-time data pipelines, enterprise-grade data platforms, and cloud data solutions.
Domain
Financial services / Cloud data engineering
Deliverable
production ML models
Required skills
Azure cloud services, Azure Data Factory, Azure Databricks, Python, Java, SQL, DevOps lifecycle, REST web services, microservice architecture
Preferred skills
Financial services industry experience, data-heavy systems experience
Technologies
Azure, Azure Data Factory, Azure Databricks, Databricks Unity Catalog, Jenkins, Git, Jira, Confluence, MS SQL Server
Responsibilities
Build large-scale batch and real-time data pipelines in Azure; Develop, test, and modify software to improve data platform efficiency; Integrate data from various sources adhering to quality standards; Enable streaming data use-cases; Partner with stakeholders to develop enterprise-grade platforms; Review and provide feedback on core code changes.
Seniority
Senior, indirect leadership & mentorship