Data Engineer / Metadata Engineer
Core
Design, develop, and optimize scalable data pipelines, metadata repositories, and data governance solutions to support enterprise analytics and data management.
Role type
Senior Data Engineer / Metadata Engineer
Builds
Enterprise data pipelines, data warehouses, data lakes, lakehouse architectures, and metadata catalogs
Domain
Cloud data platforms (Azure, AWS, GCP) and Data Governance
Required skills
ETL/ELT pipeline development, SQL, data warehousing, metadata management, data lineage, data cataloging, cloud platform engineering, data modeling, data quality monitoring
Preferred skills
Enterprise data catalog platforms (Purview, Collibra, Alation, Informatica EDC, Apache Atlas), Data Mesh, Data Fabric, MDM, AI/ML support
Technologies
Azure, AWS, Google Cloud Platform, SQL, Apache Atlas, Microsoft Purview, Collibra, Alation, Informatica EDC
Responsibilities
Design and maintain scalable data pipelines and ETL/ELT processes; Design and maintain enterprise metadata repositories and data catalogs; Implement data quality monitoring and validation controls; Develop and optimize data models and lakehouse architectures; Partner with stakeholders to define data ownership and stewardship models; Document system designs, data flows, and metadata models
Seniority
Senior, hands-on IC