Data engineer
Based in Spain
Core
Build and automate data pipelines, migrate to cloud environments, and modernize Big Data infrastructure.
Role type
Data Engineer
Builds
Data pipelines, cloud migration projects, Big Data infrastructure
Domain
Big Data, Cloud Infrastructure
Deliverable
production ML models
Required skills
Spark with Scala, CI/CD tools (GitLab, Jenkins), HDFS, SQL databases, Apache Airflow, S3/COS storage, Parquet/ORC formats, SQL and NoSQL databases, Hadoop, Oozie, Shell scripting
Preferred skills
English C1
Technologies
Spark, Scala, GitLab, Jenkins, HDFS, Apache Airflow, S3, COS, Parquet, ORC, Hadoop, Oozie, Shell
Responsibilities
Develop and automate data pipelines, migrate systems to cloud environments, modernize Big Data infrastructure
Seniority
Mid-level, hands-on IC