Data Engineer (Snowflake/DataStage)
Core
Designing and maintaining scalable, automated data pipelines to load and transform data for enterprise analytics and strategic business use.
Role type
Senior Data Engineer (ETL/ELT)
Builds
Reliable data integration and transformation solutions for business and technology initiatives
Domain
Enterprise data warehousing and analytics
Deliverable
production ML models | product features
Required skills
SQL, ETL/ELT pipeline design, data integration tools, data profiling, metadata management, data quality monitoring, code reviews, unit testing
Preferred skills
Snowflake data modeling and optimization, IBM DataStage, Data Vault modeling, workflow orchestration (Apache Airflow), GitHub CI/CD, DataOps practices, streaming technologies (Kafka/Confluent), cloud platforms (AWS/Azure/GCP)
Technologies
Snowflake, IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo, Apache Kafka, Confluent, MuleSoft, Axway, Apache Airflow, GitHub
Responsibilities
Create and maintain data pipelines for key data and analytics capabilities; Profile data to assess accuracy and completeness; Create data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments; Monitor data quality to detect emerging issues and create transformation rules; Participate in code reviews and unit testing to optimize performance
Seniority
Senior, hands-on IC
