Data Engineer - Big Data – Scala, Spark, Azure Confirmé H/F
Core
Design and develop Big Data solutions to collect, transform, exploit, and deliver large volumes of data.
Role type
Senior Big Data Engineer (Scala/Spark/Azure)
Builds
Data pipelines, processing treatments, and dashboards for business teams
Domain
Big Data / Cloud Data Engineering
Required skills
Scala, Apache Spark, Azure Databricks, Hadoop, Python, Linux, Airflow, CI/CD, Unit Testing, Performance Testing, Monitoring, DevOps
Preferred skills
Distributed systems development, Data quality and security practices, Documentation
Technologies
Scala, Spark, Hadoop, Azure, Databricks, Python, Linux, Qlik, Airflow, OpenShift, GitHub
Responsibilities
Analyze requirements with business and technical teams; Design and develop new Big Data treatments; Develop and optimize data pipelines on Azure Databricks; Participate in dashboard creation and data valorization; Perform unit, component, and performance tests; Monitor treatments and platform; Maintain and follow up production applications; Contribute to DevOps, CI/CD, and continuous deployment; Ensure quality, security, and compliance; Document solutions and share best practices.
Seniority
Senior, hands-on IC