Data Engineering Technical Lead
Core
Lead the technical design, development, and optimization of scalable data platforms and data products on AWS and Databricks to support business decision-making across Financial Advice Services, Marketing, Operations, and Risk.
Role type
Senior IC Data Engineering Technical Lead
Builds
Scalable data pipelines, Data Lake solutions (Bronze/Silver/Gold), and real-time processing workloads on AWS/Databricks.
Domain
Financial Services / Cloud Data Engineering
Deliverable
production ML models
Required skills
Databricks, PySpark, SQL, Apache Spark, Delta Lake, Unity Catalog, Terraform, CI/CD, Data Modeling, Batch/Streaming Processing
Preferred skills
AWS data platforms, Delta Live Tables, MLflow, AI/ML, MLOps, Generative AI, Financial Services industry experience
Technologies
AWS, Databricks, PySpark, SQL, Apache Spark, Delta Lake, Unity Catalog, Terraform, Git
Responsibilities
Design and build scalable data pipelines; Develop and manage Data Lake solutions; Optimize Databricks workloads; Establish data quality, governance, and security controls; Lead technical delivery and code reviews; Collaborate with stakeholders to deliver data products; Mentor engineers.
Seniority
Senior, hands-on IC with leadership responsibilities
