DevOps Infrastructure Engineer (w/m/d) für die Integration der Infrastruktur der Zwicky Transient Facility (ZTF) am DZA
Core
Building and operating a high-throughput, near real-time data processing and archival system for the Zwicky Transient Facility (ZTF) to monitor astronomical sources and trigger robotic telescope observations.
Role type
DevOps Infrastructure Engineer (HPC & Data Engineering)
Builds
Scalable, modern IT infrastructure and data pipelines for astronomical research
Domain
Astrophysics / High-Performance Computing / Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Unix/Linux administration, Shell scripting, CI/CD and GitOps, High-Performance Computing (HPC) and job scheduling (Slurm), Infrastructure-as-Code (Terraform, Ansible), PostgreSQL operations, Apache Kafka, Data Engineering (ETL, Airflow, Spark), Network fundamentals (TCP/IP, DNS)
Preferred skills
Perl programming
Technologies
Slurm, CephFS, Lustre, Terraform, Ansible, PostgreSQL, Apache Kafka, Apache Airflow, Spark
Responsibilities
Migrate legacy data pipelines to modern tools, build and maintain storage solutions for high data volumes, implement reliable data ingest workflows, operate batch processing in HPC environments, provide and maintain supporting services and interfaces, document processes according to DevOps principles
Seniority
Mid-Senior, hands-on IC
