Lead Data Engineer
Core
Lead a team to build feature stores, data pipelines, and MLOps solutions for AI-enhanced underwriting and credit risk models in the financial sector.
Role type
Senior IC Lead Data Engineer (AI/ML Infrastructure)
Builds
Feature stores, scalable data pipelines, and MLOps infrastructure for machine learning models
Domain
Financial Services / AI & Machine Learning
Deliverable
production ML models
Required skills
Python, PySpark, Data Engineering, ETL, DevOps, CI/CD, Metadata Management, Feature Engineering, Team Leadership, Agile/Scrum
Preferred skills
Docker, Kubernetes, AWS/Azure/GCP, Financial Industry Risk Analytics
Technologies
PySpark, Spark SQL, PostgreSQL, Git, AWS, Azure, GCP, Docker, Kubernetes
Responsibilities
Develop feature stores with integrated data quality and governance; Design and implement pipelines for feature extraction, transformation, and storage; Ensure data consistency, lineage, and metadata management; Collaborate with data scientists to standardize feature definitions; Implement reusable pipelines and MLOps solutions; Lead technical innovation and team delivery
Seniority
Senior, hands-on IC with team lead responsibilities
