IN_Sr Associate_Big Data Developer _Data & Analytics _Advisory _Mumbai
Core
Build and optimize large-scale data pipelines and analytics solutions for financial services clients to drive strategic insights and operational efficiency.
Role type
Senior Associate Big Data Developer (Advisory)
Builds
Data pipelines, ingestion flows, and analytics solutions for BFSI clients
Domain
Financial Services (BFSI) / Big Data & Analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Spark (Scala/PySpark), SQL, Hadoop ecosystem (HDFS, YARN, Tez), Kafka, NiFi/StreamSets, Cloudera Manager, Oozie/Airflow, Linux/Unix, Shell scripting, Git, CI/CD, Data warehousing (dimensional modelling), AWS/Azure/GCP cloud platforms
Preferred skills
Advanced cloud platform expertise (EMR, Glue, Synapse, Dataproc), Unit testing, Observability, Technical design documentation
Technologies
Hadoop, Spark, Kafka, NiFi, StreamSets, Cloudera Manager, YARN, Tez, HDFS, Oozie, Airflow, Linux, Jenkins, GitLab CI, AWS EMR, AWS Glue, Azure HDInsight, Azure Synapse, GCP Dataproc, BigQuery
Responsibilities
Develop robust Spark jobs (batch and streaming) with unit tests and observability; Implement ingestion patterns (Kafka/NiFi), data quality checks, and job scheduling; Analyze and tune SQL/Spark for large-scale datasets; Write technical design documents (HLD/LLD) and perform integration testing; Work in onsite–offshore model using SDLC/Agile methodologies
Seniority
Senior Associate, hands-on IC
