Systemutvecklare / Data Engineer till Data Lake-plattform
Core
Building and maintaining a Data Lake platform and research infrastructure to support healthcare and research needs with structured, quality-assured data.
Role type
Senior Data Engineer
Builds
Production data pipelines, integration services, and data processing platforms for a university hospital
Domain
Healthcare / Data Engineering
Required skills
Python, SQL, ETL/ELT, Data Lake technologies, API integration, Container orchestration, Data security and anonymization
Preferred skills
Apache Iceberg, Delta Lake, Trino, Azure/AWS, CI/CD, Clinical data experience
Technologies
Apache Spark, Apache Iceberg, Delta Lake, Docker, Kubernetes, OpenShift, Azure, AWS
Responsibilities
Develop and maintain metadata-driven ETL/ELT pipelines, build and manage integrations with databases and source systems, handle anonymization and quality assurance of sensitive data, implement monitoring and alerting for production environments, collaborate with architects and business representatives
Seniority
Senior, hands-on IC