Specialist, Data Engineering
Core
Designing, developing, and maintaining data integration and transformation processes on a cloud-based data platform, ensuring data governance, classification, and compliance.
Role type
Data Engineering Specialist
Builds
Cloud-based data pipelines and enterprise-grade data solutions
Domain
Cloud Data Engineering & Data Governance
Deliverable
production ML models
Required skills
Cloud platform expertise (AWS/Azure/GCP), RDBMS optimization (PostgreSQL/MySQL/Oracle), ETL/ELT pipeline development, Data governance frameworks, Scripting (Python/Bash), Data orchestration (Airflow), SQL query optimization, API integration (REST/SOAP), Linux/UNIX environment management, Data lineage and metadata management
Preferred skills
Google Cloud Platform (GCP) experience, Bilingualism (English/French)
Technologies
GCP, AWS, Azure, Collibra, Airflow, Bash, Python, PostgreSQL, MySQL, Oracle, SQL Server, Git, Linux/UNIX, REST, SOAP, XML, JSON, SSL, TLS, SSH
Responsibilities
Develop and orchestrate data pipelines for ingestion from various sources into a cloud-based environment; Collaborate with Data Analysts and Data Architects on defining data models and architecture; Implement and maintain data governance frameworks focusing on classification, lineage, and documentation; Automate manual tasks using scripting languages and enterprise scheduling tools; Partner with cross-functional teams to gather data requirements and improve data-driven decision-making.
Seniority
Mid-Senior, hands-on IC