CareerPlan

Lead Data Engineer

New York, NY (1271 AOA/6th Ave), USFull-time$112k–$200k2026-11-13 → 2026-11-18
Hybrid · United States

Core

Design, build, and maintain scalable enterprise data pipelines and platforms using Snowflake, Python, and Azure.

Role type

Lead Data Engineer

Builds

Scalable ETL/ELT frameworks, data pipelines, and cloud-based data solutions

Domain

Financial services / Data Engineering

Required skills

Snowflake, Python, SQL, Apache Airflow, Microsoft Azure, Data Modeling, ETL/ELT, Performance Optimization, Data Warehousing

Preferred skills

Databricks, Apache Spark, Azure Data Factory, Data Governance, Lakehouse Architecture

Technologies

Snowflake, Python, Airflow, Azure, Databricks, Spark, SQL

Responsibilities

Design and develop scalable data pipelines and ETL/ELT frameworks; Build and optimize data solutions using Snowflake; Develop reusable data engineering components using Python; Design and orchestrate complex workflows using Apache Airflow; Develop and support cloud-based data solutions using Microsoft Azure; Partner with business and technology teams to translate requirements into scalable solutions; Define technical designs, integration patterns, and engineering standards; Implement data quality, monitoring, lineage, and security controls; Troubleshoot production issues and drive improvements; Conduct design and code reviews and provide technical guidance to teams.

Seniority

Senior, hands-on IC with leadership responsibilities