Lead Data Engineer
Core
Design, build, and scale high-performance, cloud-enabled data pipelines and platforms for Mastercard's enterprise data warehouse and lakehouse environments to support global payment processing.
Role type
Lead Data Engineer (Cloud & Big Data)
Builds
Enterprise data warehouse, lakehouse environments, and petabyte-scale batch/near real-time data processing frameworks.
Domain
Financial Services / Big Data Engineering
Required skills
Apache Spark, Java/Scala, Hadoop ecosystem, AWS (S3, EMR, Glue), SQL, NoSQL databases, Data orchestration (Airflow/NiFi), Cloud migration
Preferred skills
Lakehouse architectures, Data lineage/cataloguing, POC initiatives
Technologies
Apache Spark, Java, Scala, Hadoop, Amazon S3, EMR, Glue, Airflow, NiFi, Oracle, SQL Server, Cassandra, DynamoDB
Responsibilities
Design and deploy scalable data pipelines; Build petabyte-scale processing frameworks; Migrate legacy ETL workloads to cloud-native architectures; Mentor junior engineers; Troubleshoot production incidents and perform root cause analysis.
Seniority
Senior, hands-on IC with leadership responsibilities
