Data Engineer con Inglés
Core
Design, develop, and optimize data pipelines and maintain a corporate Data Hub for the banking sector.
Role type
Senior Data Engineer
Builds
Data pipelines and corporate Data Hub solutions
Domain
Banking / Cloud Data Engineering
Deliverable
production ML models
Required skills
Scala, Apache Spark, Hadoop, SQL, CI/CD, Apache Airflow, Shell Scripting, Kubernetes, S3/COS storage
Preferred skills
Dremio
Technologies
Scala, Spark, Hadoop, GitLab, Jenkins, HDFS, Airflow, Kubernetes, S3, COS, Dremio
Responsibilities
Design and optimize data pipelines; ensure data quality, availability, and integrity; resolve incidents; automate processes via CI/CD; integrate and transform data from multiple sources; participate in cloud migration projects.
Seniority
Senior, 6+ years total experience with 3+ years as Data Engineer