IN_Senior Associate_Cloud Data Engineer_Data and Analytics_Advisory_Pan India
Core
Design and build scalable data infrastructure, pipelines, and transformation solutions on cloud platforms to enable efficient data processing and analysis for clients.
Role type
Senior Cloud Data Engineer
Builds
Data pipelines, data integration solutions, and data warehousing systems
Domain
Cloud Data Engineering (AWS, Azure, GCP)
Deliverable
production ML models | product features | dashboards & analysis
Required skills
PySpark, Python, SQL, Cloud Data Engineering, Data Ingestion, Data Transformation, Data Warehousing, Performance Optimization, Spark Streaming
Preferred skills
Cloud Certifications (AWS/Azure/GCP), Spark Streaming expertise
Technologies
AWS (Glue, Athena, Lambda, Redshift, Step Functions, DynamoDB, SNS), Azure (Data Factory, Synapse Analytics, Functions, Cosmos DB, Event Grid, Logic Apps, Service Bus), GCP (Dataflow, BigQuery, DataProc, Cloud Functions, Bigtable, Pub/Sub, Data Fusion), Databricks
Responsibilities
Design, build, and maintain scalable data pipelines across AWS, Azure, Databricks, and GCP; Implement data ingestion and transformation processes for efficient data warehousing; Optimize Spark job performance for high efficiency and reliability; Work on Spark Streaming for real-time data processing; Collaborate with cross-functional teams to deliver robust data solutions.
Seniority
Senior, hands-on IC
