Ingénieur Data Confirmé - Services Financiers - Bordeaux
Core
Data integration engineer responsible for collecting, preparing, and integrating reliable data to fuel Big Data analytics and applications for a major client.
Role type
Senior Data Integration Engineer
Builds
Data pipelines and integrated datasets for client analytics and applications
Domain
Financial Services / Big Data Infrastructure
Deliverable
production ML models | infrastructure
Required skills
ETL, data collection, structured and unstructured data integration, continuous data stream management, metadata management, performance optimization, automation, data security
Preferred skills
collaboration, curiosity, logical thinking, digital transformation passion
Technologies
Cloudera Data Platform, Openshift, Kubernetes, Kafka, Camel, Benthos, Airflow, Argo, Ceph, MinIO, Parquet, Avro, Iceberg, PostgreSQL, MongoDB, Oracle Database, Spark, Pyspark, Scala, Java, Trino, Dremio, Jupyter, Hive, Beeline, Dataiku, Gitlab, Harbor, Superset, DigDash, Angular
Responsibilities
Collect data, perform ETL processes, integrate structured and unstructured data, manage continuous data flows, ensure data security, manage metadata, optimize performance and scalability, collaborate with other teams, plan and automate workflows, maintain and monitor systems
Seniority
Senior, hands-on IC
