AWS Data Engineer
Core
Design, develop, and optimise scalable data pipelines and data platforms on AWS to enable data-driven decision making and analytics.
Role type
Data Engineer (AWS)
Builds
Scalable data pipelines, ETL/ELT workflows, and data lake/lakehouse architectures
Domain
Cloud data engineering, AWS ecosystem
Deliverable
production ML models | product features
Required skills
AWS Glue, Python, PySpark, SQL, YAML configuration, data pipeline orchestration, data validation, performance optimization
Preferred skills
Data lake/lakehouse architecture concepts, distributed processing frameworks, cloud-native development patterns
Technologies
AWS Glue, S3, PySpark, Python, SQL, YAML
Responsibilities
Build and maintain data pipelines and workflows on AWS platforms; Develop ETL/ELT pipelines using AWS Glue, Python/PySpark, and SQL; Test and validate data pipelines and processing jobs; Optimise data jobs for performance, scalability, and cost efficiency; Support implementation of modern data platforms including data lakes and lakehouse-style architectures
Seniority
Mid-level, hands-on IC