Data Engineer
Core
Design and maintain scalable, automated data pipelines to load, transform, and integrate data from legacy, web, cloud, and purchased sources into analytics environments for strategic business use.
Role type
Data Engineer
Builds
Data pipelines, data mappings, programs, routines, and SQL solutions
Domain
Enterprise data analytics and integration
Deliverable
production ML models | product features
Required skills
SQL coding, ETL/ELT pipeline design, data integration tools, data profiling, metadata management, code review, unit testing
Preferred skills
Event store and stream processing, API development and management, data warehouse MPP platforms
Technologies
IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo, Snowflake, Netezza, Teradata, Redshift, Apache Kafka, Confluent, MuleSoft, Ax
Responsibilities
Create data mappings and routines to acquire data from diverse environments; optimize data movement using ELT, ETL, and data virtualization; monitor data quality and create transformation rules; participate in code reviews and unit testing; document data requirements and pipeline solutions.
Seniority
Mid-level, hands-on IC