CareerPlan

Lead Data Engineer

HyderabadFull-time2026-07-08 → 2026-11-11

Core

Lead the design and delivery of a cloud-native healthcare data platform, building scalable data solutions for health plans and providers.

Role type

Senior Lead Data Engineer (Cloud & Data Platform)

Builds

Scalable cloud data platforms, batch and near-real-time pipelines, and reusable data frameworks on AWS.

Domain

Healthcare / Cloud Data Engineering

Required skills

Data Engineering, Technical Leadership, AWS (S3, Glue, Athena, Lake Formation), Apache Iceberg, dbt, Python, SQL, PySpark/Spark, Data Quality, Observability

Preferred skills

Delta Lake, Hudi, Airflow, Step Functions

Technologies

AWS, Apache Iceberg, dbt, Airflow, Step Functions, Python, SQL, PySpark, Delta Lake, Hudi

Responsibilities

Lead delivery of complex data engineering projects across multiple teams, Design and implement batch and near-real-time pipelines, Build reusable ingestion, transformation, validation, and publishing frameworks, Lead Apache Iceberg implementation and optimization, Define standards for schema evolution, partitioning, compaction, and metadata management, Mentor engineers and establish best practices

Seniority

Senior, hands-on IC with leadership responsibilities