Data Engineer spark scala
Core
Designing and developing high-performance data pipelines for large enterprise clients, migrating legacy Hadoop/Spark workloads to Snowflake.
Role type
Senior Data Engineer (Snowflake/Spark/Scala)
Builds
Robust data pipelines and migration projects for enterprise clients
Domain
Big Data, Cloud Data Warehousing, Enterprise Software
Required skills
Scala, Apache Spark, Snowflake, Snowpark, CI/CD pipelines, Git, Data modeling, Clean code practices
Preferred skills
Hadoop/Cloudera ecosystem, Agile/Scrum methodologies
Technologies
Snowflake, Snowpark, Spark, Scala, Git, Cloudera
Responsibilities
Develop and maintain robust data pipelines on Snowflake and Snowpark; Contribute to migrating Spark/Scala Hadoop treatments to Snowflake; Apply and promote development best practices (quality, tests, performance); Design data flows, data models, and transformations; Ensure quality, consistency, and maintainability of delivered treatments; Maintain reliable and industrial-grade CI/CD chains
Seniority
Senior, hands-on IC