Data Engineer, ShipTech Analytics
Core
Build standardized data solutions, near-real-time streaming pipelines, and batch processing pipelines to power Amazon's global transportation network and enable self-service analytics.
Role type
Senior IC Data Engineer
Builds
Scalable data pipelines, data products, and data tools for the transportation network
Domain
Logistics / Transportation / Big Data
Deliverable
production ML models
Required skills
Data modeling, ETL pipelines, SQL, Python/Java/Scala/NodeJS, Distributed systems, Big data technologies (Hadoop, Hive, Spark, EMR)
Preferred skills
AWS technologies (Redshift, S3, Glue, Kinesis, Lambda), Non-relational databases, Streaming architectures (Kafka, Flink, Beam)
Technologies
AWS, Hadoop, Hive, Spark, EMR, Kafka, Kinesis, Flink, Redshift, S3, Glue, Lambda
Responsibilities
Design and build scalable NRT and batch data pipelines; Build data products and tools for the complete data lifecycle; Partner with stakeholders to design solutions and deliver datasets; Own data quality and implement enhancements; Collaborate on standardizing analytics capabilities and AI automation; Drive continuous improvement through code reviews and mentoring
Seniority
Mid-Senior, hands-on IC