AWS (Redshift/Kinesis+Pyspark) - Associate 2
Core
Build AWS-based data pipelines using Redshift, Kinesis, and PySpark to move and transform data for analytics use within the Advisory practice.
Role type
Associate 2 Data Engineer (AWS Cloud)
Builds
Data pipelines, ingestion, transformation, and loading workflows on cloud data platforms
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models
Required skills
AWS services, Redshift, Kinesis, PySpark, data pipeline development, data quality validation, troubleshooting, technical documentation
Preferred skills
Management Information Systems or Computer Science background, AWS data services coursework, cloud data pipeline knowledge, data pattern interpretation
Responsibilities
Build AWS-based data pipelines using Redshift, Kinesis, and PySpark; Develop ingestion, transformation, and loading workflows; Write and tune Spark code for scalable processing; Support data modernization efforts; Validate data quality, completeness, and consistency; Troubleshoot pipeline failures and query performance issues; Document technical workflows; Collaborate with team members and client stakeholders
Seniority
Associate, hands-on IC