CareerPlan

Lead Data Engineer

San Francisco, California; Seattle, WashingtonFull-time$165k–$266k2026-11-06 → 2026-11-20
Hybrid · United StatesNo visa sponsorship

Core

Lead the data engineering design for an explainable, configurable engine that converts normalized cloud and operational data into actionable cost attribution.

Role type

Lead Data Engineer (FinOps/Cost Attribution)

Builds

Batch and streaming pipelines for Azure and GCP billing data, normalized cost models, and executive dashboards for product-level cost views and burn-rate reporting.

Domain

Cloud FinOps, Cost Management, Data Engineering

Required skills

SQL, Python, data modeling, ELT/ETL architecture, orchestration, observability, technical leadership, multi-cloud billing normalization, data contracts, schema lineage, failure-handling patterns, event-driven ingestion, deployment automation.

Preferred skills

FinOps, cloud-cost allocation, showback/chargeback, cost-to-serve, unit-economics, Microsoft Fabric, repeatable infrastructure automation, mentoring.

Technologies

Azure, GCP, Microsoft Fabric, Data Lake, Data Factory, KQL

Responsibilities

Build batch and/or streaming pipelines for Azure and GCP billing data; Normalize provider-specific billing and usage data into a consistent model; Implement reconciliation checks between source billing systems and downstream reporting datasets; Create reusable transformations that support executive dashboards and anomaly detection; Build operational visibility for pipeline health including freshness, latency, and schema drift; Partner with platform, FinOps, and Finance teams to resolve data-quality gaps; Document pipeline behavior, ownership, and recovery procedures; Improve automation, test coverage, and cost efficiency of the data platform; Participate in on-call rotations and incident response.

Seniority

Lead, Individual Contributor