Data Engineer II, Data Engineer II
Core
Design, develop, test, and deploy Supply Chain Application and Process Automation, including ETL pipelines and data integration solutions.
Role type
Data Engineer
Builds
Scalable data pipelines, APIs, and UIs for AWS Infrastructure Supply Chain & Procurement
Domain
Cloud Infrastructure / Supply Chain
Required skills
SQL, Python, Data Modeling, Warehousing, ETL Pipeline Development, API Design, UI Development, Data Orchestration, Code Review, Version Control
Preferred skills
AWS Redshift, AWS S3, AWS Glue, AWS EMR, AWS Kinesis, AWS FireHose, AWS IAM, NoSQL Databases, Graph Databases, Column-family Databases
Technologies
AWS EC2, AWS Lambda, AWS DynamoDB, AWS Elastic Search, SQL, Python
Responsibilities
Design and develop pipelines for optimal extraction, transformation, and loading of data from various sources; Oversee and improve production operations including optimizing data delivery and release management; Establish and maintain best practices for data integration solutions; Collaborate with Product teams and Data Scientists to explore new data sources; Read, write, and debug data processing and orchestration code following best coding standards.