Data Engineer Expérimenté.e (H/F)
Core
Design and build robust, high-performance data pipelines to ingest, transform, optimize, and expose complex, large-scale data flows for client systems.
Role type
Senior Data Engineer (Big Data)
Builds
Data pipelines and ingestion tools for client systems
Domain
Big Data, Cloud, Data Engineering
Deliverable
production ML models
Required skills
Big Data (Hadoop, Spark, Kafka), Java, Python, SQL, Cloud (AWS, GCP, Azure), Data modeling, CI/CD
Preferred skills
Scala, Flink, DBT, Databricks, GCP BigQuery
Technologies
Hadoop, Spark, Kafka, Java, Python, AWS, GCP, Azure, DBT, Databricks, Flink, Sqoop, Hive, HBase, Phoenix, Kudu, Dataiku, Jira, Git, Jenkins, SonarQube, Kibana, Ambari, Yarn, Oozie, Hue, Impala, Teradata, RabbitMQ, SFTP
Responsibilities
Design and implement complex data processing workflows; Manage Hadoop clusters and optimize data storage; Perform data ingestion and transformation using ETL tools; Collaborate with architects and data scientists to ensure data availability; Optimize query performance for data science models; Maintain CI/CD pipelines and monitor data processing volumes.
Seniority
Senior, hands-on IC