AWS Data Engineer
Core
Design, build, and maintain scalable data pipelines and infrastructure using AWS-native services to support high-performance data workflows.
Role type
AWS Data Engineer
Builds
Scalable data pipelines and data infrastructure
Domain
Cloud data engineering
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Apache Airflow, Docker, AWS Redshift, AWS OpenSearch, AWS Lambda, AWS Glue, AWS Step Functions, AWS Batch, Git, CI/CD pipelines, IAM policies, RBAC
Preferred skills
AWS Athena, AWS SQS, AWS CloudWatch, AWS CloudTrail, AWS EMR, Terraform, CloudFormation
Technologies
AWS Redshift, AWS OpenSearch, AWS Lambda, AWS Glue, AWS Step Functions, AWS Batch, Apache Airflow, Docker, GitLab, Terraform, CloudFormation
Responsibilities
Develop and maintain data pipelines using Python and SQL; Containerise data applications and workflows using Docker; Build and optimise data solutions using AWS services; Monitor and troubleshoot data pipeline performance and reliability; Ensure data quality, governance, and security best practices are followed.
Seniority
All levels
