Senior Data Engineering Developer (8 Month-Fixed-Term)
Core
Designing, developing, and supporting high-quality, sustainable data fulfilment solutions and scalable data pipelines to ingest and process high-volume transactions for Canada's financial ecosystem.
Role type
Senior Data Engineering Developer
Builds
Scalable data pipelines, data aggregations, infrastructure, and tooling for transaction processing and business initiatives.
Domain
Financial technology / Payments / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Data pipeline design and implementation, Distributed systems, SQL (dimensional modeling), RDBMS (Oracle), Big Data technologies (Hive, Impala), Apache Spark (PySpark), ETL/ELT, Data streaming, Data warehousing, Third-party API integration, CI/CD practices, Data transformation testing
Preferred skills
Github, Agile environments, Problem analysis and resolution, New technology investigation
Technologies
Oracle, Hive, Impala, Apache Spark, PySpark, Github
Responsibilities
Designing and monitoring scalable processes for high-volume transaction ingestion, Collaborating to translate business requirements into data strategies, Overseeing data pipeline design and architecture enhancement, Developing standards for data processes and automating routine tasks, Writing tests and documentation for processes and tooling, Managing and monitoring data flows for integrity and performance, Participating in rotating on-call support
Seniority
Senior, hands-on IC