Data Engineer, PV Prime Video TV - Tech
Core
Design and implement scalable data infrastructure solutions integrating multiple heterogeneous data sources to support reporting, analysis, and machine learning models for Prime Video's commerce analytics.
Role type
Senior Data Engineer (AWS Big Data)
Builds
Scalable data pipelines, curated datasets, and high-performing data products on native AWS infrastructure.
Domain
Streaming media, e-commerce, and digital content distribution.
Deliverable
production ML models | dashboards & analysis | infrastructure
Required skills
Data modeling, warehousing, ETL pipeline development, SQL, AWS big data technologies, batch and near real-time processing, workflow orchestration
Preferred skills
Non-relational databases, object storage, document stores, graph databases, column-family databases
Technologies
AWS Redshift, EMR/Spark, Andes Data Lake, S3, AWS Glue, Kinesis, FireHose, Lambda, IAM
Responsibilities
Design complex data pipelines for subscription, transaction, and device registration datasets; Develop data quality validation frameworks and monitoring solutions; Build and optimize batch and near real-time processing workflows; Create robust orchestration for workflows with complex dependencies; Collaborate with cross-functional teams to onboard new data sources
Seniority
Senior, hands-on IC