Lead Data Engineer
Core
Lead Data Engineer building scalable data pipelines to transform raw telemetry usage data into rated, validated, and invoice-ready billing data for SAP invoicing.
Role type
Senior Lead Data Engineer (Billing Transformation)
Builds
Scalable data pipelines, curated usage datasets, rating logic, and SAP invoice feeds
Domain
Financial markets infrastructure / Usage-based billing
Required skills
AWS Glue, PySpark, Python, SQL, Snowflake, CI/CD, data quality checks, reconciliation frameworks, batch and event-driven ingestion, data modeling
Preferred skills
Usage-based billing domain knowledge, financial data processing, performance tuning, cost optimization
Responsibilities
Design and build data ingestion pipelines from telemetry systems, implement rating logic and billing-ready datasets, generate SAP invoice feeds, build data quality and reconciliation frameworks, manage exception handling and error processes, maintain CI/CD pipelines for deployments, create operational monitoring and alerting dashboards, write technical documentation and runbooks
Seniority
Senior, hands-on IC with leadership responsibilities
