Team Lead - Databricks Engineer
Core
Lead a technical team of data engineers to build and maintain Citco's enterprise-wide Centralized Data Platform (CDP) on Databricks, ensuring performance, security, and scalability.
Role type
Senior Team Lead Databricks Data Engineer
Builds
Enterprise-wide Centralized Data Platform (CDP) on Databricks
Domain
Financial services / Data Engineering / Cloud
Deliverable
production ML models
Required skills
Databricks internals, Python, Spark, AWS, data modeling, SQL, Delta Lake, Lakehouse architecture, ETL/ELT, Git, pipeline optimization, team leadership
Preferred skills
Financial services experience, multi-cloud, AI/ML implementation, API development, real-time processing, data governance
Technologies
Databricks, AWS (S3, Glue, Lambda), Python, SQL, Delta Lake, Unity Catalog, Git
Responsibilities
Lead a technical team of data engineers, ensure best practices in performance/security/scalability, deliver large-scale data platforms, optimize data pipelines, mentor junior team members
Seniority
Senior, hands-on IC with leadership