Data Engineer
Core
Designing and developing data transformation flows and monitoring production data pipelines for business teams and analytics units.
Role type
Data Engineer
Builds
Data transformation flows and production data pipelines
Domain
Financial services / Data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, PySpark, pandas, Dataiku, AWS, Kubernetes, data pipeline design, code review, documentation
Preferred skills
Agile methodology, cloud migration experience, mentoring, solution-oriented approach
Technologies
Python, SQL, PySpark, Dataiku, AWS, Kubernetes
Responsibilities
Designing and developing optimized data processing flows, coordinating with business teams on use cases, monitoring production pipeline execution, defining and distributing good practices for the datalab platform
Seniority
Mid-level, hands-on IC