AWS Data Engineer (Senior)
Core
Senior Data Engineer consolidating and migrating customer data infrastructure on AWS, designing data models, and building production pipelines using PySpark, SQL, and orchestration tools.
Role type
Senior IC data engineer (AWS modernization)
Builds
Production data pipelines, data models, and querying solutions for customer data infrastructure
Domain
Cloud data engineering (AWS)
Deliverable
production ML models | product features
Required skills
PySpark, SQL, Amazon EMR, Amazon Glue, Amazon Redshift, Snowflake, Amazon Athena, Presto, Airflow, data modeling, pipeline orchestration
Preferred skills
AWS Data Analytics Specialty Certification, Agile development methodology
Technologies
PySpark, SQL, Amazon EMR, Amazon Glue, Amazon Redshift, Snowflake, Amazon Athena, Presto, Airflow
Responsibilities
Build and maintain data pipelines on Amazon EMR or Amazon Glue that run in production. Design data models and end-user querying on Amazon Redshift or Snowflake, Amazon Athena, and Presto. Build and maintain pipeline orchestration with Airflow. Troubleshoot and optimize pipelines and data models until they hold up under real load. Write and maintain PySpark and SQL scripts to extract, transform, and load data. Track new AWS data technologies and judge their impact on the systems we run.
Seniority
Senior, hands-on IC