Senior Data Engineer - Halifax
Core
Design, implement, and support data architecture best practices and processes for Risk IT Data Services across the global organization.
Role type
Senior Data Engineer (Risk IT)
Builds
Data pipelines, micro-service architectures, and optimized Big Data applications.
Domain
Financial Services / Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Java, Scala, Spark, Spring Framework, Spring Boot, Micro-service architecture, Data pipeline development, CI/CD (Jenkins), Git, JIRA, Unit/Integration/Acceptance testing, Technical documentation
Preferred skills
Credit Risk Markets knowledge
Technologies
Cloudera, HDP, Jenkins, Git, JIRA, Spark, Java, Scala, Spring, Spring Boot
Responsibilities
Provide consulting services on new initiatives; Explore and implement emerging technologies; Develop, code, document, and execute tests; Optimize Spark jobs and Java applications; Architect and design solutions; Participate in requirements gathering and data modeling; Prepare technical specifications; Develop detailed project plans and estimates.
Seniority
Senior, hands-on IC with leadership responsibilities