Data Platform Engineer (m/w/d)
Core
Design, operate, and maintain enterprise Big Data platforms for clients in finance, industry, and public sectors.
Role type
Senior Data Platform Engineer
Builds
Production-grade Big Data platforms (Hadoop, Kafka, Spark, Kubernetes) and backup solutions
Domain
Big Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Linux system administration, Shell scripting, Big Data technologies (Hadoop, Kafka, Spark), Container orchestration (Kubernetes/OpenShift), Infrastructure as Code (Terraform, Ansible), Python/Java/Scala programming
Preferred skills
Analytical and conceptual abilities
Technologies
HDFS, Hive, YARN, HBase, Kafka, S3, Open Table Format, Cloudera Data Services, Stackable Data Platform, Kubernetes, Terraform, Ansible, Git, Grafana, RHEL
Responsibilities
Consult on Big Data technologies, integrate new platforms into client environments, manage platform operations (patching, upgrades, monitoring), automate recurring tasks via IaC, develop backup solutions
Seniority
Senior, hands-on IC
