Lead Data Engineer - Mississauga
Core
Lead end-to-end technical delivery for complex data engineering initiatives, designing scalable batch and real-time pipelines and enabling advanced analytics and ML use cases.
Role type
Senior IC Lead Data Engineer
Builds
Scalable, reliable batch and real-time data pipelines across internal and external systems
Domain
Healthcare enterprise data engineering and analytics
Deliverable
production ML models | product features
Required skills
Data architecture, ETL/ELT patterns, large-scale data processing, SQL, Python, scripting, Databricks, Snowflake, Azure Data Factory, Confluent Kafka, Azure Event Hub, PySpark, Apache Airflow, dbt, Alation, data modeling, metadata, lineage, data quality, cloud platforms (SaaS/PaaS/IaaS), Infrastructure as Code
Preferred skills
Leading enterprise-scale data initiatives, real-time event-driven data architectures, data governance programs, emerging data and AI technologies, highly regulated business environments
Technologies
Airflow, Azure, Cloud, Databricks, ETL, Kafka, Machine Learning, PaaS, Power BI, Python, PySpark, SQL, Snowflake, Tableau, dbt
Responsibilities
Design and build scalable, reliable batch and real-time data pipelines; Lead solution design and shape architectural decisions; Define and maintain engineering standards and best practices; Mentor and guide data engineers through design and code reviews; Ensure quality, reliability, performance, and maintainability of data products; Partner with stakeholders to turn analytical needs into scalable solutions; Oversee testing strategies, production readiness, observability, and operational stability; Proactively identify and remediate technical debt; Enable advanced analytics and ML use cases through optimized data models; Communicate technical designs, tradeoffs, risks, and results clearly
Seniority
Senior, hands-on IC with technical leadership