Sr Data Engineer - Music DISCO, Music DISCO
Core
Build and maintain automated self-service data solutions, data science models, and deep-dive analytics to improve customer retention, engagement, and experience on Amazon Music.
Role type
Senior IC Data Engineer (Big Data & Analytics Platform)
Builds
Scalable data pipelines, data warehousing solutions, and self-service analytics platforms for the DISCO team and broader Consumer Product Tech org.
Domain
Music streaming, Big Data, Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data modeling, ETL pipeline development, SQL, Python/Java/Scala/NodeJS, AWS CDK, PySpark, Airflow, Data warehousing design, Team mentoring
Preferred skills
Big data technologies (Hadoop, Hive, Spark, EMR), Large data warehouse operations
Technologies
AWS (Redshift, S3, EMR, EC2, DynamoDB, Kinesis Firehose, Lambda), SQL, PySpark, Airflow, CDK, SageMaker
Responsibilities
Design and architect modern data analytics platforms on AWS; Develop robust and scalable data pipelines using SQL/PySpark/Airflow; Design and implement efficient data warehousing solutions; Automate ETL/ELT processes; Create data models to support business intelligence; Enable advanced analytics and machine learning capabilities; Monitor and optimize data pipeline performance; Implement security measures and data compliance; Create comprehensive technical documentation.
Seniority
Senior, hands-on IC with mentoring responsibilities