Data Engineer
Core
Design high-performance data pipelines (ETL), implement flow automation via CI/CD, design data models and schemas, and provide architectural guidance for advanced reporting and analytics solutions.
Role type
Data Engineer
Builds
Data pipelines, automated flows, data models, and schemas
Domain
Banking / Credit Risk / Data Engineering
Deliverable
production ML models
Required skills
ETL/ELT data integration, SQL, Python, PySpark, CDP architecture, HDP architecture
Preferred skills
Dataiku, SAS, Apache NiFi, Agile methodology, JIRA, credit risk knowledge
Technologies
Dataiku, SAS, Apache NiFi, CI/CD, JIRA
Responsibilities
Design high-performance data pipelines (ETL), Implement flow automation through CI/CD pipelines, Design data models and schemas, Transform and/or translate code, Support MS4U teams on coding phase, Optimize code developed by MS4U teams, Provide end-users with support on the handling of Dataiku
Seniority
Mid-level, hands-on IC