Data Engineer
Core
Design, build, and maintain scalable, automated, and fault-tolerant data pipelines to load and transform data for enterprise analytics and strategic business use.
Role type
Senior Data Engineer
Builds
Data pipelines, data integration solutions, and analytics environments
Domain
Enterprise data engineering and analytics
Deliverable
production ML models
Required skills
SQL, ETL/ELT design, data pipeline development, data profiling, metadata management, data quality monitoring, code review, unit testing
Preferred skills
Data virtualization, event store/stream processing, API development, MPP data warehouse platforms
Technologies
SQL, Apache Kafka, AWS Glue, Snowflake, Redshift, Teradata, Netezza, IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, Denodo, MuleSoft, Axway
Responsibilities
Create data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments; monitor data quality to detect issues and create transformation rules; participate in code reviews and unit testing to optimize performance.
Seniority
Senior, hands-on IC
