CareerPlanSign in

Lead Data Engineer

O'Fallon, Missouri💼 Full-time🗓 2026-08-31 → 2026-09-26

Core

Design and scale next-generation data platforms powering credit decisioning, portfolio risk management, regulatory reporting, and AI-driven insights for Mastercard's lending and risk ecosystems.

Role type

Lead Data Engineer (Technical Lead)

Builds

Enterprise-grade data platforms, pipelines, and governed data products for credit risk and analytics.

Domain

Financial Services / Credit Risk / Data Engineering

Deliverable

production ML models | product features | dashboards & analysis

Required skills

Large-scale data engineering, Distributed data processing, Databricks, Apache Spark/PySpark, Delta Lake, Cloud platforms (Azure/AWS/GCP), ETL/ELT pipelines, Data modeling, Data governance, CI/CD, Workflow orchestration (Airflow), Security & compliance

Preferred skills

Java development, Hadoop, Kafka, Azure Data Services, GitHub

Technologies

Databricks, Apache Spark, Delta Lake, Azure, AWS, GCP, Airflow, Kafka, Parquet, Avro, ORC

Responsibilities

Lead design and development of enterprise data platforms; Architect scalable ETL/ELT frameworks; Drive cloud transformation and legacy migration; Establish data quality and governance frameworks; Partner with Risk, Product, and Data Science teams; Mentor engineers and shape technology roadmaps.

Seniority

Senior, hands-on IC with leadership responsibilities

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.