Sr. Enterprise Data Engineer
Core
Designing and creating complex data pipelines and curated data structures/products for the SHC Enterprise Data Platform to support data analysts, improve patient experience, and enable research capabilities.
Role type
Senior Enterprise Data Engineer
Builds
Data ingestion processes, pipelines, and curated data structures/products for the SHC Enterprise Data Platform
Domain
Healthcare technology / Cloud data lake
Deliverable
production ML models | product features
Required skills
Advanced data modeling, Cloud data platform development (Azure, Databricks), PySpark, SQL, DevOps, CI/CD, Orchestration, Relational database design, Performance tuning, Root cause analysis
Preferred skills
None stated
Technologies
Azure, Databricks, PySpark, Notebooks, GitHub
Responsibilities
Design and implement complex data pipelines and stores; Consult and support other data engineers on data movement processes; Research and maintain performance of standard data modeling and DevOps tools; Innovate with new technologies to enhance efficiency; Perform analysis, development, and testing of complex data marts; Participate in data governance as a technical data steward; Lead teams to define design standards and conduct peer reviews; Define analytics standards and support analyst training; Troubleshoot incidents and establish countermeasures.
Seniority
Senior, hands-on IC