Data Engineer, Amazon Traffic Engineering
Core
Build robust data pipelines and analytics systems to support real-time bot detection and mitigation for Amazon's global infrastructure.
Role type
Senior Data Engineer (Traffic Engineering)
Builds
Data pipelines, data products, and analytics solutions for bot detection and traffic management
Domain
Cybersecurity, Traffic Engineering, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, ETL/ELT, Data Modeling, Warehousing, AWS Glue, AWS EMR, AWS Athena, AWS Redshift, Airflow, Spark, Oracle
Preferred skills
Non-relational databases, Object storage, Document stores, Key-value stores, Graph databases, Column-family databases, AWS Kinesis, AWS FireHose, AWS Lambda, AWS IAM
Technologies
Python, EMR, Spark, Airflow, Glue, Athena, Redshift, Oracle, S3, Kinesis, FireHose, Lambda, IAM
Responsibilities
Build robust data pipelines using AWS and internal tools; Collaborate with business, science, and engineering teams; Automate infrastructure and deployment processes; Ensure data quality, accuracy, and governance; Implement data security measures; Optimize systems for scalability; Create user-friendly data products for analytics and experimentation