Lead Data Engineer (Corporate Sector)
Core
Designing and operating secure, scalable cloud-based data platforms, pipelines, and analytics solutions for a large financial institution.
Role type
Senior Lead Data Engineer
Builds
Batch and streaming data pipelines, workflow orchestration, and data warehousing/lakehouse architectures
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models
Required skills
Python, PySpark, SQL, Apache Airflow, Cloud platforms (AWS/Azure/GCP), System Design, Data Modeling, Agile
Preferred skills
Enterprise AI integration, Security compliance, Mentorship
Technologies
Python, PySpark, SQL, Airflow, AWS, Azure, GCP
Responsibilities
Build and optimize batch and streaming data pipelines; Develop and operate workflow orchestration; Model and transform data with SQL; Write production-grade Python and PySpark code; Mentor junior engineers; Validate enterprise-authorized AI outputs
Seniority
Senior, hands-on IC with leadership responsibilities