Data Engineer II, GTPC Tech, Compliance & Assurance, AWS Security
Core
Design and deliver data engineering solutions to enable AWS expansion into new data centers worldwide, supporting compliance and sustainability programs.
Role type
Senior IC data engineer (AWS cloud infrastructure)
Builds
Next-generation complex data pipelines and BI solutions for AWS services
Domain
Cloud infrastructure, global trade compliance, data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data modeling, warehousing, ETL pipeline construction, distributed systems operation, modern programming (Python, Ruby, Golang, Java, C++, C#, Rust), scripting languages, complex SQL, infrastructure as code, code reviews, testing, operational excellence
Preferred skills
End-to-end project delivery, non-relational databases (object, document, key-value, graph, column-family), software engineering best practices, batch and real-time data processing, AWS Big Data Technologies (EMR, Athena, EC2, Redshift, IAM, S3), relational databases (PostgreSQL, SQL Server, MySQL)
Technologies
AWS (S3, EC2, RDS, Redshift, Kinesis, EMR, Lambda, Glue, Airflow), Python, Ruby, Golang, Java, C++, C#, Rust, SQL, Bash/Perl
Responsibilities
Architecture design and implementation of data pipelines, manage AWS resources, build data architecture for business analysts and data scientists, extract/transform/load data from diverse sources, improve reporting processes and automate self-service support, participate in code reviews and design discussions
Seniority
Senior, hands-on IC