Senior Data Engineer
Core
Design and develop scalable data pipelines and support batch and real-time data processing solutions in a secure enterprise environment.
Role type
Senior Data Engineer (Big Data)
Builds
Scalable data pipelines, batch and real-time processing solutions, APIs, and data services
Domain
Enterprise Big Data / Secure Infrastructure
Deliverable
production ML models
Required skills
Scala, Apache Spark, Java, Kafka, Hive, HBase, HDFS, Hadoop ecosystem, SQL, CI/CD, automated testing
Preferred skills
Agile delivery, stakeholder management, mentoring
Technologies
Spark, Scala, Kafka, Hive, HBase, HDFS, Hadoop
Responsibilities
Design and develop scalable data pipelines; Build and support batch and real-time data processing solutions; Analyse requirements and provide technical designs; Develop APIs, data services and reusable engineering frameworks; Deliver high-quality, well-tested code and perform code reviews; Support CI/CD, automation and production operations; Mentor junior engineers
Seniority
Senior, hands-on IC