Data Engineer
Core
Build data privacy-compliant analytics insights and robust Big Data analytics applications for clients.
Role type
Senior Data Engineer (Big Data & Cloud)
Builds
Automated quality checks, data pipelines, and analytics applications
Domain
Cybersecurity, GRC, Big Data, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Scala, SQL, Apache Spark, Hadoop, Kafka, Redis, Hive, Impala, Azure Databricks, AWS, Google Cloud, IBM Public Cloud, Jupyter, R, Git, DevOps tools
Preferred skills
Machine Learning algorithms, data partitioning, transformation, in-memory computations, Spark application design, pipeline optimization, customer requirement gathering
Technologies
Apache Spark, Hadoop, Cassandra, Kafka, Redis, Hive, Impala, Azure Databricks, IBM Public Cloud, Google Cloud, AWS, Jupyter, R
Responsibilities
Translate business objectives into actionable data analytics code; craft robust Big Data analytics applications; champion automation for quality checks; collaborate with Data Science and Privacy Risk teams; implement best practices in data management and information security.
Seniority
Senior, hands-on IC