Senior Data Engineer
Core
Design, build, and scale high-performance, cloud-enabled data pipelines and platforms for Mastercard's enterprise data warehouse and lakehouse environments to support global payment processing.
Role type
Senior IC data engineer (cloud & big data)
Builds
Enterprise data warehouse, lakehouse environments, and scalable data processing frameworks
Domain
Financial services / Payments / Big Data
Deliverable
production ML models
Required skills
Apache Spark, Java/Scala, Hadoop ecosystem, AWS (S3, EMR, Glue), SQL, NoSQL (Oracle, SQL Server, Cassandra, DynamoDB), Apache Airflow/NiFi, data pipeline architecture, cloud migration
Preferred skills
Data lineage and metadata management, observability, root cause analysis, POC development
Technologies
Apache Spark, Java, Scala, Hadoop, Amazon S3, EMR, Glue, Airflow, NiFi, Oracle, SQL Server, Cassandra, DynamoDB
Responsibilities
Design and deploy scalable data pipelines; build batch and near real-time processing frameworks; migrate legacy ETL workloads to cloud-native architectures; implement data quality controls and observability; mentor junior engineers; troubleshoot production incidents
Seniority
Senior, hands-on IC
