Senior Data Engineer-1
Core
Design, develop, and deliver end-to-end batch and real-time data pipelines for Mastercard's cloud strategy, ensuring systems are resilient and maintainable.
Role type
Senior individual-contributor data engineer
Builds
Complex data pipelines, dbt transformation architectures, CI/CD pipelines, and data observability frameworks
Domain
Fintech / Payments / Cloud Data Engineering
Required skills
Databricks administration, Spark, Python, PySpark, dbt, CI/CD (GitLab, Jenkins), DataOps, real-time streaming (Kafka, Spark Structured Streaming), SQL, cloud infrastructure (AWS/Azure/GCP), mentoring
Preferred skills
Banking, e-commerce, or credit card processing experience; SaaS and premises-based architecture exposure
Technologies
Databricks, Spark, Python, PySpark, dbt, GitLab, Jenkins, Kafka, AWS, Azure, GCP
Responsibilities
Own end-to-end design and delivery of batch and real-time pipelines; Drive dbt-based transformation architecture with TDD; Administer and optimize Databricks objects; Establish data observability frameworks; Lead design of real-time streaming pipelines; Mentor junior and mid-level engineers; Partner with stakeholders on requirements and trade-offs
Seniority
Senior, hands-on IC with mentorship responsibilities
