CareerPlan

Data Engineer

Dublin, Co. DublinRemoteFull-time2024-06-21 → 2026-11-16
Remote

Core

Build data privacy-compliant analytics insights and robust Big Data analytics applications for clients.

Role type

Senior Data Engineer (Big Data & Cloud)

Builds

Automated quality checks, data pipelines, and analytics applications

Domain

Cybersecurity, GRC, Big Data, Cloud Infrastructure

Deliverable

production ML models

Required skills

Python, Scala, SQL, Apache Spark, Hadoop, Kafka, Redis, Hive, Impala, Azure Databricks, AWS, Google Cloud, IBM Public Cloud, Jupyter, R, Git, DevOps tools

Preferred skills

Machine Learning algorithms, data partitioning, transformation, in-memory computations, Spark application design, pipeline optimization, customer requirement gathering

Technologies

Apache Spark, Hadoop, Cassandra, Kafka, Redis, Hive, Impala, Azure Databricks, IBM Public Cloud, Google Cloud, AWS, Jupyter, R

Responsibilities

Translate business objectives into actionable data analytics code; craft robust Big Data analytics applications; champion automation for quality checks; collaborate with Data Science and Privacy Risk teams; implement best practices in data management and information security.

Seniority

Senior, hands-on IC