Lead Data Engineer
Core
Design, build, and maintain scalable enterprise data pipelines and platforms using Snowflake, Python, and Azure.
Role type
Lead Data Engineer
Builds
Scalable ETL/ELT frameworks, data pipelines, and cloud-based data solutions
Domain
Financial services / Data Engineering
Required skills
Snowflake, Python, SQL, Apache Airflow, Microsoft Azure, Data Modeling, ETL/ELT, Performance Optimization, Data Warehousing
Preferred skills
Databricks, Apache Spark, Azure Data Factory, Data Governance, Lakehouse Architecture
Technologies
Snowflake, Python, Airflow, Azure, Databricks, Spark, SQL
Responsibilities
Design and develop scalable data pipelines and ETL/ELT frameworks; Build and optimize data solutions using Snowflake; Develop reusable data engineering components using Python; Design and orchestrate complex workflows using Apache Airflow; Develop and support cloud-based data solutions using Microsoft Azure; Partner with business and technology teams to translate requirements into scalable solutions; Define technical designs, integration patterns, and engineering standards; Implement data quality, monitoring, lineage, and security controls; Troubleshoot production issues and drive improvements; Conduct design and code reviews and provide technical guidance to teams.
Seniority
Senior, hands-on IC with leadership responsibilities