Big Data Engineer (Java/ Spark) @ Scalo
Core
Designing and implementing solutions for processing large datasets, creating and developing data pipelines based on Spark, and translating business requirements into technical solutions.
Role type
Senior Big Data Engineer (Java/Spark)
Builds
Scalable, resilient, and automated data processing pipelines for international clients
Domain
Financial services / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Spark, Java, SQL, Hive, Python, CI/CD, DevOps, Airflow, API design, Microservices, Git, Data pipeline architecture, Code review, Agile methodology, International collaboration
Preferred skills
Banking industry experience, French language proficiency
Technologies
Spark, Java, SQL, Hive, Python, Airflow, Git
Responsibilities
Designing and implementing solutions for processing large datasets, Creating and developing data pipelines in Spark, Ensuring quality, performance, and reliability of data processes, Industrializing data processing (scalability, resilience, automation), Participating in code reviews and quality initiatives, Supporting applications and resolving production issues, Participating in defining Big Data architecture, Identifying project risks and proposing corrective actions
Seniority
Senior, hands-on IC
