Senior Data Engineer
Core
Design, build, and operate scalable, secure cloud data platforms and production-grade data pipelines to power analytics, AI, and decision-making.
Role type
Senior Cloud Data Engineer
Builds
Cloud-native data pipelines, lakehouse architectures (bronze/silver/gold), and data products for BI and AI/ML workloads.
Domain
Government security and identity systems (border security, civil identity, driver licenses) on Microsoft Azure.
Required skills
Cloud data engineering, lakehouse/medallion architecture, data pipeline orchestration, SQL, PySpark, Python, data governance, security practices, DataOps, infrastructure-as-code, technical mentorship
Preferred skills
AI/ML feature engineering, Microsoft Fabric (OneLake, pipelines), CI/CD for data platforms, experience in regulated environments
Technologies
Microsoft Azure, Microsoft Fabric, Databricks, Azure Data Factory, PySpark, SQL
Responsibilities
Design and maintain scalable batch and near-real-time data ingestion and transformation pipelines; Implement lakehouse architectures to support analytics and AI; Collaborate with data scientists on feature engineering and model training; Enforce data quality, lineage, and security controls; Automate deployment and optimize cloud costs; Provide technical leadership and mentorship to junior engineers
Seniority
Senior, hands-on IC with mentorship responsibilities (via careerplan.io/jobs/12411-senior-data-engineer-at-canadian-bank-note-company)