IN_Senior Associate – AWS Data Engineer – Data and Analytics – Advisory – Bangalore
Core
Design and build scalable data ingestion and ETL/ELT pipelines on AWS to transform raw data into actionable insights for clients.
Role type
Senior Associate AWS Data Engineer
Builds
Production data pipelines, direct-to-Aurora ingestion strategies, and monitoring frameworks for high-volume EOD workloads.
Domain
Cloud Data Engineering (AWS)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Expert SQL development, Python, PySpark, ETL/ELT pipeline orchestration, ACID-compliant data ingestion, Schema evolution, CDC patterns, Cloud-native architecture design
Preferred skills
SAP ODP, Distributed PostgreSQL, Event-driven architectures (Kafka)
Technologies
AWS Glue, AWS Step Functions, AWS Lambda, AWS DMS, Aurora, PostgreSQL, Kafka
Responsibilities
Develop ETL/ELT pipelines using AWS services; Implement direct-to-Aurora ingestion strategies; Ensure referential integrity and idempotency; Build monitoring and validation frameworks; Manage scalability for high-volume ingestion workloads
Seniority
Senior, hands-on IC