IN-Senior Associate_ Data Engineering__ Data & Analytics _ Advisory _Bangalore
Core
Design, develop, and maintain scalable data pipelines and architectures using Spark, PySpark, and Python to drive business insights and optimize operations.
Role type
Senior IC data engineering lead (advisory)
Builds
Scalable data pipelines, data architectures, and cloud-native data platforms
Domain
Data Engineering, Cloud Computing, Big Data
Deliverable
production ML models | product features
Required skills
Spark, PySpark, Python, Data Warehousing, ETL, Data Quality, Team Leadership, Project Management
Preferred skills
Databricks, Azure Data Engineering, AWS, Docker, Kubernetes, Data Visualization, Machine Learning concepts
Technologies
Spark, PySpark, Python, Databricks, Azure, AWS, Docker, Kubernetes, BigQuery, Redshift, S3, EMR
Responsibilities
Design and maintain scalable data pipelines and architectures; Lead and manage a team of data engineers; Collaborate with cross-functional teams to deliver data solutions; Ensure data quality, integrity, and security; Implement best practices for code reviews, testing, and documentation; Manage project timelines, resources, and budgets
Seniority
Senior, hands-on IC with leadership responsibilities