Lead Data Engineer
Core
Lead the data engineering design for an explainable, configurable engine that converts normalized cloud and operational data into actionable cost attribution.
Role type
Lead Data Engineer (FinOps/Cost Attribution)
Builds
Batch and streaming pipelines for Azure and GCP billing data, normalized cost models, and executive dashboards for product-level cost views and burn-rate reporting.
Domain
Cloud FinOps, Cost Management, Data Engineering
Required skills
SQL, Python, data modeling, ELT/ETL architecture, orchestration, observability, technical leadership, multi-cloud billing normalization, data contracts, schema lineage, failure-handling patterns, event-driven ingestion, deployment automation.
Preferred skills
FinOps, cloud-cost allocation, showback/chargeback, cost-to-serve, unit-economics, Microsoft Fabric, repeatable infrastructure automation, mentoring.
Technologies
Azure, GCP, Microsoft Fabric, Data Lake, Data Factory, KQL
Responsibilities
Build batch and/or streaming pipelines for Azure and GCP billing data; Normalize provider-specific billing and usage data into a consistent model; Implement reconciliation checks between source billing systems and downstream reporting datasets; Create reusable transformations that support executive dashboards and anomaly detection; Build operational visibility for pipeline health including freshness, latency, and schema drift; Partner with platform, FinOps, and Finance teams to resolve data-quality gaps; Document pipeline behavior, ownership, and recovery procedures; Improve automation, test coverage, and cost efficiency of the data platform; Participate in on-call rotations and incident response.
Seniority
Lead, Individual Contributor