CareerPlan

VP, Data Engineering Technical Lead

HQ - San Diego, CAFull-time$125k2026-06-01 → 2026-11-18
Based in United States

Core

Lead the modernization of legacy data systems into a cloud-native Lakehouse environment powering analytics, AI, and BI.

Role type

VP, Data Engineering Technical Lead

Builds

Scalable data pipelines, reusable data design patterns, and AI-integrated operational intelligence.

Domain

Financial Services / Data Engineering

Deliverable

production ML models

Required skills

Data pipeline architecture, Data design patterns (CDC, SCD, Medallion), Cloud platforms (Azure, GCP), Big Data tools (Databricks, Spark, dbt, Airflow, Kafka), Legacy ETL modernization (SSIS/SSRS), AI-assisted engineering, SQL, Python/Scala/Java

Preferred skills

Predictive modeling for operational intelligence, CI/CD implementation, Team mentorship

Technologies

Databricks, Apache Spark, dbt, Fivetran, Airflow, Kafka, Delta Live Tables, Iceberg, Azure Synapse, Google BigQuery

Responsibilities

Modernize legacy ETL pipelines to cloud-native architectures; Architect reusable data design patterns across ingestion and consumption layers; Develop and lead POCs/POVs for emerging technologies; Leverage AI tools for code generation and pipeline optimization; Apply ML for operational intelligence (anomaly detection, data drift); Enforce engineering excellence via CI/CD and observability; Mentor data engineers on best practices; Optimize performance and cost of Spark workloads.

Seniority

VP, hands-on technical lead