CareerPlan

Lead Data Engineer

Pune, IndiaFull-time2026-07-16 → 2026-11-16

Core

Design and build next-generation, cloud-native data platforms supporting Mastercard's global data ecosystem, including scalable batch and real-time data pipelines.

Role type

Lead Data Engineer (Senior IC)

Builds

Scalable batch and real-time data pipelines, ETL/ELT frameworks, and cloud-native data platforms on AWS, Azure, or GCP.

Domain

Payments / Financial Services / Cloud Data Engineering

Required skills

Java (JDK 8+), Python, Go, Apache Spark, Kafka, AWS/Azure/GCP, Terraform, Docker, Kubernetes, SQL, Airflow, CI/CD, Data Modeling

Preferred skills

Apache Flink, Databricks, EMR, BigQuery, Redshift, Snowflake, Splunk, Dynatrace, JMeter, Gatling

Technologies

Spark, Kafka, Flink, Terraform, CloudFormation, S3, ADLS, GCS, EMR, Databricks, BigQuery, Redshift, Snowflake, Airflow, Jenkins, GitHub Actions, Splunk, Dynatrace, Prometheus, JMeter, Gatling

Responsibilities

Design and build scalable batch and real-time data pipelines; Develop robust ETL/ELT frameworks; Implement stream processing solutions; Ensure data quality, lineage, and governance; Drive cost optimization strategies; Provide technical leadership and mentorship; Conduct code and architecture reviews.

Seniority

Senior, hands-on IC with leadership responsibilities