Ingénieur Big Data (F/H)
Core
Design, develop, and operate high-volume batch and streaming data processing pipelines in a distributed environment.
Role type
Senior Big Data Engineer
Builds
Data pipelines (batch/streaming), distributed processing components, real-time data flows
Domain
Data Engineering / Big Data
Deliverable
production ML models | product features
Required skills
Distributed data processing, Apache Spark, SQL, Kafka, Python, Java, Shell scripting
Preferred skills
AI tool integration (code assistants, automated documentation), data quality for AI models
Technologies
Spark, SQL, Kafka, Python, Java, Shell, Git
Responsibilities
Design and maintain batch and streaming data pipelines; Develop distributed processing with Spark; Implement and optimize SQL treatments; Set up and operate real-time flows with Kafka; Integrate data ingestion tools with Python; Develop and maintain Java and Shell components; Participate in testing, production deployment, and monitoring
Seniority
Mid-Senior, hands-on IC
