Technology Engineering Lead
On-site
Core
Lead the architecture, development, and production rollout of a batch feature store for analytics and AI use cases.
Role type
Senior IC data engineering lead
Builds
Batch feature store, scalable PySpark and Impala SQL pipelines
Domain
Data engineering, enterprise data platforms
Deliverable
production ML models
Required skills
PySpark, Impala SQL, Hive, Oracle, batch scheduling (CA7), Linux scripting, Git/Bitbucket, CI/CD, technical design, team leadership
Preferred skills
Banking or financial services experience
Technologies
PySpark, Impala, Hive, Oracle, CA7, Jira, Bitbucket
Responsibilities
Design scalable data pipelines, define feature logic and data quality standards, manage batch scheduling, conduct design/code reviews, coordinate production releases, collaborate with stakeholders
Seniority
Senior, hands-on IC with leadership responsibilities