Big Data Engineer - Services Financiers - Ile de France
Core
Design and implement data engineering solutions for client projects, focusing on data ingestion, DataLake structuration, and data processing from batch to streaming in a Cloud environment.
Role type
Senior Big Data Engineer
Builds
Data ingestion pipelines, DataLake architectures, and data processing chains for client digital transformation projects.
Domain
Financial Services / Big Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, Scala, Java, Apache Spark, Hadoop, Kafka, Cloud platforms (Azure), CI/CD pipelines, Data governance
Preferred skills
DataOps, Prototype Design, Proof of Concept, MVP development, mentoring
Technologies
Spark, Hadoop, Hive, Kafka, Elastic, Cloudera, Azure HD Insight, Informatica, Talend, Stambia, DataStage, SAS, DataIku, DataBricks, Qlik, SAP BI, Power BI
Responsibilities
Translate business needs into data engineering solutions, implement data ingestion (batch/streaming), structure DataLake and governance processes, process data to business exposure, manage CI/CD pipelines, conduct technology scouting and build prototypes.
Seniority
Senior, hands-on IC
