Data Platform Engineer (m/w/d)
Core
Design, operate, and maintain enterprise Big Data platforms for clients in finance, industry, and public sectors.
Role type
Senior Data Platform Engineer
Builds
Scalable Big Data platforms (Hadoop, Kafka, Spark, Kubernetes) and backup solutions for client environments
Domain
Big Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Linux system administration, Shell scripting, Big Data technologies (Hadoop, Kafka, Spark), Container orchestration (Kubernetes/OpenShift), Infrastructure as Code (Terraform, Ansible), Python/Java/Scala
Preferred skills
Analytical and conceptual abilities, knowledge of backup solutions for data platforms
Technologies
HDFS, Hive, YARN, HBase, Kafka, S3, Open Table Format, Cloudera Data Services, Stackable Data Platform, Kubernetes, Terraform, Ansible, Git, Grafana, RHEL
Responsibilities
Consult on Big Data technologies, integrate new platforms into existing systems, automate recurring tasks via IaC, ensure platform security and stability, evaluate new tools and frameworks
Seniority
Senior, hands-on IC
