Data Engineer - Künstliche Intelligenz (m/w/d)
Core
Build scalable applications for automated consolidation, processing, and analysis of large datasets for machine learning, from concept to production.
Role type
Senior Data Engineer (Machine Learning)
Builds
Scalable ML applications and pipelines for clients in industry and public sector
Domain
Artificial Intelligence / Machine Learning / Big Data
Deliverable
production ML models
Required skills
Python, SQL, Natural Language Processing, Machine Learning Pipelines, Big Data processing, Database technologies (PostgreSQL, Hive, Elastic, Cassandra), Data orchestration (Kafka, Airflow, NiFi, Spark), Cloud platforms, Kubernetes, Docker, CI/CD tools
Preferred skills
Experience with Enterprise security requirements, Identity Management, Data privacy regulations
Technologies
Hadoop, Kubernetes, Kafka, Airflow, NiFi, Spark, PostgreSQL, Hive, Elastic, Cassandra, Docker, Jenkins, git
Responsibilities
Design and implement ML pipelines for various data types (time series, images, documents); Evaluate and select new tools and technologies; Optimize application quality and performance; Collaborate with Data Scientists to realize AI use cases (Entity Extraction, Recommender, Chatbots); Manage applications and stakeholders during development and operations
Seniority
Senior, hands-on IC
