Développeur Big Data (Spark/Java) - (H/F)
Core
Big Data developer modernizing legacy data processing pipelines and migrating them to a cloud-based Databricks architecture for a strategic institutional client.
Role type
Senior Big Data Engineer (Spark/Java)
Builds
Modernized data processing pipelines and cloud data infrastructure on Databricks
Domain
Public sector / Energy (Linky system) / Big Data
Deliverable
production ML models | product features
Required skills
Apache Spark, Java, SQL, PL-SQL, Object-Oriented Programming, Data Pipeline Design, Cloud Migration, Performance Optimization
Preferred skills
Data Governance, Agile Methodology, DevOps practices, Technical Roadmap Definition
Technologies
Databricks, Ceph, Maven, Control-M, Git, Jenkins, Terraform, Tableau Server
Responsibilities
Migrate legacy Informatica and PL/SQL treatments to Spark/Java architectures, Design and implement data pipelines on Databricks, Maintain and evolve existing SQL/PL-SQL treatments, Ensure data performance, robustness, and quality, Participate in RUN and continuous improvement of treatments, Contribute to the Spark guild for optimization and technical roadmap definition
