KI Ressourcement (m/w/d)
Core
Testing, planning, and documentation of Large Language Models (LLMs), including performance analysis, optimization, and integration within MCP-Server architectures.
Role type
Senior IC LLM testing and integration engineer
Builds
Production-ready LLM systems and test frameworks for Automotive, Aerospace, Defense, and Machinery sectors
Domain
Artificial Intelligence / Large Language Models / Software Engineering
Deliverable
production ML models
Required skills
LLM testing (functional, prompt evaluation, regression, performance), MCP-Server integration, API and service integration, Python programming, AI pipeline/orchestration knowledge, technical documentation, tool/plugin/agent mechanisms for LLMs
Preferred skills
Prompt Engineering, Retrieval-Augmented Generation (RAG), evaluation techniques, cloud/container infrastructure knowledge
Responsibilities
Conduct, plan, and document tests for Large Language Models (LLMs); Analyze, evaluate, and optimize model performance (quality, robustness, hallucinations, bias, response consistency); Integrate, configure, and validate AI tools within an MCP-Server architecture; Support connection of external services and tools (e.g., Search, Retrieval, APIs) to LLM-based systems; Collaborate on the development of AI infrastructures, toolchains, and test frameworks; Document test results, interfaces, and technical concepts; Identify optimization and automation potential in the AI environment
Seniority
Senior, hands-on IC
