Lead Data Engineer
Core
Design and build next-generation, cloud-native data platforms supporting Mastercard's global data ecosystem, including scalable batch and real-time data pipelines.
Role type
Lead Data Engineer (Senior IC)
Builds
Scalable batch and real-time data pipelines, ETL/ELT frameworks, and cloud-native data platforms on AWS, Azure, or GCP.
Domain
Payments / Financial Services / Cloud Data Engineering
Required skills
Java (JDK 8+), Python, Go, Apache Spark, Kafka, AWS/Azure/GCP, Terraform, Docker, Kubernetes, SQL, Airflow, CI/CD, Data Modeling
Preferred skills
Apache Flink, Databricks, EMR, BigQuery, Redshift, Snowflake, Splunk, Dynatrace, JMeter, Gatling
Technologies
Spark, Kafka, Flink, Terraform, CloudFormation, S3, ADLS, GCS, EMR, Databricks, BigQuery, Redshift, Snowflake, Airflow, Jenkins, GitHub Actions, Splunk, Dynatrace, Prometheus, JMeter, Gatling
Responsibilities
Design and build scalable batch and real-time data pipelines; Develop robust ETL/ELT frameworks; Implement stream processing solutions; Ensure data quality, lineage, and governance; Drive cost optimization strategies; Provide technical leadership and mentorship; Conduct code and architecture reviews.
Seniority
Senior, hands-on IC with leadership responsibilities