Data Engineer Spark / Scala - H/F
Core
Design, implement, and optimize modern data platform solutions and decision-making architectures for clients.
Role type
Senior Data Engineer (Spark/Scala)
Builds
Modern data platforms, decision-making solutions, and efficient data pipelines.
Domain
Data Engineering, Big Data, Cloud Data Platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Scala, Java, Python, SQL, Apache Spark, Data Warehousing, Cloud Platforms (GCP, AWS, Azure), Containerization (Docker, Kubernetes), CI/CD (Jenkins, Git, Ansible)
Preferred skills
Experience with NoSQL databases (MongoDB, ElasticSearch), Big Data technologies, emerging technology evaluation
Technologies
Spark, Scala, Java, Python, SQL, MongoDB, ElasticSearch, Snowflake, DataBricks, GCP, AWS Glue, Azure Data Factory, Ansible, Git, Jenkins, Docker, Kubernetes, Azure DevOps
Responsibilities
Design and implement modern data architectures, industrialize decision-making solutions, develop and maintain data pipelines from sourcing to visualization, ensure data quality and security throughout the lifecycle, collaborate with business teams to understand needs, evaluate and recommend emerging technologies
Seniority
Senior, hands-on IC