Senior Big Data Engineer (m/w/d)
Core
Designing and implementing Big Data strategies and modern data management architectures (Data Mesh, Data Lakehouse, Data Fabric) for clients, including batch and streaming processes.
Role type
Senior Big Data Engineer (Consulting)
Builds
Custom data solutions and AI-driven automation processes for enterprise clients
Domain
Consulting, Big Data, Cloud Computing, AI
Deliverable
production ML models
Required skills
Big Data strategy, Batch and Streaming implementation, Data Mesh/Lakehouse/Fabric architecture, Workflow Orchestration (Airflow, Luigi, Prefect), Cloud Computing (Azure, AWS, GCP), Python, Java, Scala, AI tool evaluation
Preferred skills
Experience in Big Data projects, Knowledge of data ingestion and curation technologies
Technologies
Kafka, Postgres, Oracle, Spark, Apache Airflow, Luigi, Prefect, Azure, AWS, GCP
Responsibilities
Design Big Data strategies, Implement data management architectures, Develop AI-supported solution approaches, Optimize Big Data expertise and consulting portfolio, Manage project quality and success
Seniority
Senior, hands-on IC
