Data Engineer
Core
Design, develop, and maintain data solutions for data generation, collection, and processing, specifically focusing on migrating data from legacy on-prem systems to AWS.
Role type
Senior Data Engineer (Cloud Migration & ETL)
Builds
End-to-end ETL pipelines and data migration solutions
Domain
Cloud Data Engineering (AWS)
Deliverable
production ML models | product features
Required skills
Apache Spark, AWS Glue, PySpark, SQL, ETL, Unix, Iceberg, Astronomer, Data Warehousing concepts
Preferred skills
Data pipeline architecture design, Cloud computing services, Data storage solutions
Technologies
AWS Step Functions, AWS EventBridge, AWS Lambda, CloudWatch
Responsibilities
Implement end-to-end ETL pipelines using AWS native services; Handle high-volume datasets with error handling and retry mechanisms; Collaborate with Solution Designers and DevOps engineers to test and deploy pipelines; Monitor and troubleshoot pipelines for performance and cost optimization; Support data quality validation and incremental loads.
Seniority
Senior, hands-on IC