AWS Glue Data Engineer(Redshift+Pyspark+Kinesis) - Senior Associate
Core
Design and build AWS Glue data pipelines, integration flows, and transformation solutions to turn raw data into usable insights for client engagements.
Role type
Senior Associate AWS Glue Data Engineer
Builds
Cloud-based data platforms supporting processing, integration, and analytics
Domain
Data Engineering / Cloud Modernization
Deliverable
production ML models
Required skills
AWS Glue, PySpark, Amazon Redshift, Amazon Kinesis, Data Pipeline Design, Data Modeling, Query Performance Tuning, Troubleshooting Data Integration
Preferred skills
Mentoring junior team members, Translating complex data needs into technical deliverables, Cloud engineering methods
Technologies
AWS Glue, PySpark, Amazon Redshift, Amazon Kinesis
Responsibilities
Designing and building AWS Glue data pipelines to move, transform, and load data across Redshift and cloud data stores; Developing PySpark jobs for batch and streaming processing; Integrating Kinesis data streams into ingestion workflows; Creating data models and transformation logic; Tuning query performance and pipeline throughput; Troubleshooting data integration issues; Collaborating with client stakeholders to gather requirements; Reviewing work from junior team members and providing guidance.
Seniority
Senior Associate, hands-on IC with mentorship responsibilities