Senior Data Engineer (F/M) @ ASTEK Polska
Core
Building and maintaining distributed data pipelines for decision-making processes in the automotive industry.
Role type
Senior Data Engineer
Builds
Distributed and highly parallelized data processing pipelines for large datasets (structured and unstructured)
Domain
Automotive / Big Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, SQL, Linux, Apache Spark, Hadoop, Hive, Oozie, MapReduce, BitBucket, Git, Unit Testing (Junit 5, Mockito)
Preferred skills
Advanced English
Technologies
Spark, Scala, Hadoop, Hive, Oozie, MapReduce, Junit 5, Mockito
Responsibilities
Build distributed and highly parallelized data processing pipelines for large datasets; Transform corporate data using Spark and Scala to enable data-driven products; Continuously deliver to Hadoop and other Big Data platforms; Automate processes to ensure repeatability and reliability.
Seniority
Senior, hands-on IC
