(Senior) Big Data Engineer (m/f/d)
Core
Design and implement distributed data processing pipelines and data-driven processes using big data technologies.
Role type
Senior Big Data Engineer
Builds
Data pipelines and data-driven processes for various industries
Domain
Big Data, Cloud Infrastructure, Distributed Computing
Deliverable
production ML models | infrastructure
Required skills
Python, Scala, Java, SQL, NoSQL, distributed computing, cloud infrastructure (AWS/Azure), container architectures, CI/CD, DevOps
Preferred skills
experience in multiple industries, innovative tools and methods
Technologies
AWS, Azure, Python, Scala, Java, SQL, NoSQL
Responsibilities
Process large amounts of data using distributed computing frameworks, design and implement data pipelines, work with cloud infrastructure and container architectures, collaborate on CI/CD and DevOps practices.
Seniority
Senior, hands-on IC