Data Engineer – UK Health
Core
Build a cleaned, validated, and discoverable data foundation to enable new analytical workflows and applications for UK Health.
Role type
Data Engineer
Builds
Data foundation, data integrations, data models, and output datasets
Domain
Healthcare / Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Apache Spark, Pyspark, data modeling, data cleansing, data transformation, data integration, pipeline scheduling, data monitoring, documentation
Preferred skills
data analytics software experience
Technologies
Apache Spark, Pyspark
Responsibilities
Establish new integrations into the data foundation; map out a data model with ontology and subject matter experts; perform data cleansing and transformation; configure links to other datasets; test and validate output datasets; set up schedules to regularly update data; configure monitoring and data health; produce documentation on output datasets; provide support to analytical users for creating new workflows; advise users on accessing and utilizing datasets
Seniority
Individual Contributor