Lead Data Engineer
Core
Design, build, and scale high-performance, cloud-enabled data pipelines and platforms for Mastercard's enterprise data warehouse and lakehouse environments to support global payment processing and analytics.
Role type
Lead Data Engineer (Senior IC)
Builds
Enterprise data warehouse, lakehouse environments, and scalable data processing frameworks for global payment transactions.
Domain
Financial Services / Big Data Engineering
Required skills
Apache Spark, Java/Scala, Hadoop ecosystem, AWS (S3, EMR, Glue), SQL, NoSQL (Oracle, SQL Server, Cassandra, DynamoDB), Data Orchestration (Airflow/NiFi), Cloud Migration, Data Lineage/Metadata Management, Root Cause Analysis, Technical Mentoring.
Preferred skills
Experience with modern lakehouse architectures, Proof-of-Concept (POC) development, Agile delivery in distributed teams.
Technologies
Apache Spark, Java, Scala, Hadoop, Amazon S3, EMR, Glue, Airflow, NiFi, Oracle, SQL Server, Cassandra, DynamoDB.
Responsibilities
Design and deploy scalable data pipelines; migrate legacy ETL workloads to cloud-native architectures; implement data quality controls and observability; mentor junior engineers; troubleshoot production incidents; drive engineering innovation and POCs.
Seniority
Senior, hands-on IC with leadership responsibilities.