Data Engineer II
Core
Build end-to-end data pipelines, design data models, and implement automated data processing solutions for Amazon's transportation business (AMXL) to support analytics, reporting, and ML use cases.
Role type
Senior IC data engineer (cloud/big-data)
Builds
End-to-end data pipelines, optimized datasets, and automated data processing solutions
Domain
Logistics/Transportation + Cloud/Big Data
Deliverable
production ML models
Required skills
Data modeling, ETL design, SQL, Python/Java/Scala/NodeJS, Big Data technologies (Hadoop, Hive, Spark, EMR), Non-relational databases
Preferred skills
AWS technologies (Redshift, S3, Glue, Kinesis, Lambda), Master's degree in CS/Engineering
Technologies
Redshift, Hive, EMR, Spark, SNS, SQS, Kinesis, Hadoop, S3, AWS Glue, Lambda
Responsibilities
Build end-to-end data pipelines to ingest and transform data from different sources; Utilize data from disparate sources to build meaningful datasets; Evaluate and implement big-data technologies to optimize processing; Write high performing and optimized SQL queries; Design and implement automated data processing solutions and data quality controls
Seniority
Mid-Senior, hands-on IC