Senior Data Engineer
Core
Design and maintain scalable batch and near-real-time data pipelines, curated datasets, and ML-ready feature datasets to power analytics, BI, and machine learning use cases.
Role type
Senior Data Engineer / Machine Learning Engineer
Builds
Trusted, scalable datasets and pipelines for analytics, BI, and ML workloads
Domain
Financial services / Payments / Cloud data engineering
Deliverable
production ML models | product features
Required skills
SQL, Python, Scala, distributed processing (Spark, PySpark, Hadoop), cloud data ecosystems (AWS), data modeling (dimensional, lakehouse), data quality concepts, pipeline reliability patterns, performance tuning, CI/CD (via careerplan.io/jobs/R-282559-senior-data-engineer-at-mastercard)
Preferred skills
Databricks, lakehouse platforms, ML feature pipelines, MLOps, payments/banking/regulated environments, data governance tooling, PII handling
Technologies
AWS, S3, Databricks, Spark, PySpark, Hadoop
Responsibilities
Design and build scalable data pipelines; Develop curated datasets and data models; Implement pipeline reliability patterns; Partner with data scientists for feature engineering and model operationalization; Ensure secure data handling; Drive engineering best practices
Seniority
Senior, hands-on IC
