AWS Data Engineer
Core
Designing, developing, and maintaining scalable data infrastructure and pipelines on AWS to ensure efficient data processing and storage.
Role type
AWS Data Engineer
Builds
Scalable data pipelines, ETL processes, and data warehousing solutions
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Python, PySpark, AWS Glue, SQL, AWS Athena, AWS Redshift, MDM (Master Data Management), Data Warehousing
Preferred skills
AWS CloudFormation, Data Modeling, Data Governance, Git
Technologies
AWS Glue, AWS S3, AWS Lambda, AWS Redshift, AWS Athena, AWS Step Functions, PySpark, SQL
Responsibilities
Design and maintain scalable data pipelines; Write efficient Python and PySpark code; Implement and manage ETL processes; Develop and optimize SQL queries; Utilize AWS Athena for querying large datasets; Work with AWS Redshift for data warehousing; Ensure data quality and integrity; Monitor and troubleshoot data pipeline issues.
Seniority
Mid-Senior (4+ years experience)
