DATA Engineer Big Data
Core
Senior consultant designing, implementing, and administering big data clusters and solutions for banking, luxury, insurance, energy, and finance sectors.
Role type
Senior IC Java Big Data Engineer
Builds
Data Lake pipelines, Spark/Java data processing flows, and big data architectures
Domain
Financial services and energy sector data engineering
Deliverable
production ML models | product features
Required skills
Java, Apache Spark, Scala, Hadoop, data ingestion, data quality control, load testing, unit testing, performance optimization
Preferred skills
Cloud architecture (Azure), stakeholder analysis
Technologies
Azure Cloud, Hadoop, Spark, Scala, Java
Responsibilities
Analyze business requirements, define and design big data architecture, manage data preparation and ingestion, develop Spark and Java data flows, perform load and unit testing, maintain and optimize big data solution performance
Seniority
Senior, hands-on IC
