Senior PySpark Developer (Cloudera, Iceberg, Airflow & AWS) - Tieto Tech Consulting (m/f/d)
Core
Senior Data Engineer building large-scale data pipelines and lakehouse solutions using PySpark, Cloudera, and AWS.
Role type
Senior IC Data Engineer (Big Data)
Builds
Cloud-native data lake and Lakehouse solutions, ETL/ELT pipelines
Domain
Big Data, Cloud Data Engineering
Deliverable
production ML models | product features
Required skills
PySpark, Apache Iceberg, Apache Airflow, SQL, Data Modeling, ETL/ELT, Git, CI/CD, DevOps
Preferred skills
AWS services (S3, Glue, Lambda, EMR), Kafka, Java, Data Governance, Cloud Migration
Technologies
PySpark, Cloudera Data Platform (CDP), Apache Iceberg, Apache Airflow, AWS, Kafka, Java
Responsibilities
Develop data pipelines on Cloudera Data Platform, design and manage workflows using Apache Airflow, implement data quality and governance solutions, support large-scale cloud migration initiatives
Seniority
Senior, hands-on IC