Data Engineer Big Data (F/H)
Core
Designing and maintaining scalable Big Data ecosystems, including robust batch and real-time data pipelines.
Role type
Senior Data Engineer (Big Data)
Builds
Scalable data pipelines, distributed computing jobs, and real-time streaming architectures.
Domain
Big Data, Distributed Systems, Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Apache Hadoop ecosystem, Apache Spark, Apache Kafka, Python, Scala, Java, SQL, DataOps
Preferred skills
None stated
Technologies
Hadoop, HDFS, Hive, HBase, Spark, Kafka, Python, Scala, Java
Responsibilities
Develop and maintain robust batch and real-time data pipelines; Optimize distributed computing algorithms and jobs; Configure real-time ingestion and messaging architectures; Manage and evolve Hadoop storage clusters; Monitor data flows and optimize processing times and infrastructure costs.
Seniority
Senior, hands-on IC
