Senior Data Engineer – AWS
Core
Design, develop, and optimize cloud-based data pipelines and solutions on AWS.
Role type
Senior IC data engineer
Builds
Scalable, high-performance data platforms
Domain
Cloud data engineering
Deliverable
production ML models
Required skills
AWS Glue, Amazon EMR (Spark), AWS Lambda, Apache Airflow (MWAA), Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone, Amazon S3, Python, SQL
Preferred skills
Real-time streaming (Kinesis, Kafka), Data governance and metadata management, Cost optimization in AWS
Technologies
AWS Glue, Amazon EMR, AWS Lambda, Apache Airflow, Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone, Amazon S3, Python, SQL, Kinesis, Kafka
Responsibilities
Develop and maintain batch and real-time data pipelines, Implement ETL/ELT solutions, Assist in workflow orchestration, Support serverless data processing, Participate in designing data warehousing solutions, Design and manage data storage strategies, Monitor and troubleshoot data platform issues, Collaborate with Analytics, BI, Data Science, and Business teams, Write clean, efficient code and perform peer code reviews
Seniority
Senior, hands-on IC
