Data Engineer - Remote
Core
Convert Informatica pipelines to Maia (Matillion) and Snowflake, build reusable components, and partner with clients on validation and cutover readiness for an estate of 1,500-1,700 pipelines.
Role type
Senior Data Engineer (ETL/ELT Migration)
Builds
Reusable ETL/ELT jobs, templates, validation utilities, and optimized Snowflake pipelines
Domain
Data Engineering, Cloud Data Warehousing, ETL/ELT
Required skills
Advanced SQL, Python, ETL/ELT pipeline design, Snowflake (dynamic tables, views, performance tuning), Data profiling, Legacy system analysis, Migration sequencing, Documentation
Preferred skills
Informatica, Maia (Matillion), Data ingestion tools, Azure SQL Server, MongoDB, AI-assisted development
Technologies
Snowflake, Informatica, Maia (Matillion), Azure SQL Server, MongoDB, Python, SQL
Responsibilities
Convert Informatica pipelines to Maia and Snowflake using factory-style patterns; Design and optimize Snowflake pipelines for performance and reliability; Build and support ingestion pipelines from diverse sources; Profile source data and resolve discrepancies using SQL and Python; Document migration logic and test evidence; Communicate progress and risks to stakeholders; Leverage AI tools to enhance productivity and automate routine tasks.
Seniority
Senior, hands-on IC