Lead, Data Engineer
Core
Design, deliver, and operationalize scalable data engineering and analytics solutions for the PSaS Business Unit to enable advanced analytics and ML use cases.
Role type
Senior IC Lead Data Engineer
Builds
Scalable batch and real-time data pipelines, data models, and analytics solutions
Domain
Healthcare / Enterprise Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, PySpark, Databricks, Snowflake, Azure Data Factory, Confluent Kafka, Azure Event Hub, Apache Airflow, dbt, data modeling, ETL/ELT patterns, Infrastructure as Code (IaC)
Preferred skills
Real-time event-driven data architectures, data governance, emerging AI technologies, highly regulated business environments
Technologies
Databricks, Snowflake, Azure Data Factory, Confluent Kafka, Azure Event Hub, PySpark, Power BI, Tableau, Apache Airflow, dbt, Alation
Responsibilities
Lead end-to-end technical delivery for complex data engineering initiatives; Design and build scalable, reliable batch and real-time data pipelines; Mentor and guide data engineers through design and code reviews; Partner with stakeholders to translate analytical requirements into scalable solutions; Oversee testing strategies, production readiness, and operational stability of data pipelines; Proactively identify and remediate technical debt.
Seniority
Senior, hands-on IC with leadership responsibilities