CareerPlan

Senior AI Scientist - SAP Globalization AI

Sofia Nikola Y Vaptsarov, bgFull-time2026-10-12 → 2026-11-19

Core

Lead scientific methodology, evaluation standards, and production implementation for generative AI, RAG, and agentic systems within enterprise localization.

Role type

Senior AI Scientist (Applied AI & Evaluation)

Builds

Production-grade AI capabilities, evaluation services, data pipelines, and benchmarks for generative AI, RAG, and agentic workflows.

Domain

Enterprise Software / AI / Localization

Deliverable

production ML models

Required skills

Python, Applied Statistics, Machine Learning, Deep Learning, NLP, Information Retrieval, LLM applications, RAG, Embeddings, Semantic Retrieval, Agentic workflows, Evaluation dataset design, Statistical significance analysis, Root cause analysis, CI/CD, Cloud deployment, API development, Automated testing, LLM-as-a-judge methods, Hybrid search, Reranking, Model selection, Agent architectures, Monitoring (quality, drift, latency, cost), Mentorship.

Preferred skills

Master's degree or PhD in CS/AI/ML/Data Science/Statistics, Experience with SAP Globalization context.

Technologies

Python, LLMs, RAG frameworks, Embedding models, Cloud platforms, CI/CD tools, Automated testing frameworks.

Responsibilities

Define hypotheses, baselines, success metrics, and acceptance criteria for AI systems; Develop benchmarks and evaluation methods covering retrieval quality, grounding, factual consistency, safety, and task completion; Perform systematic error analysis to trace failures to root causes in data, retrieval, ranking, context, prompts, models, tools, or agent orchestration; Research and evaluate embeddings and hybrid search using controlled experiments; Design, implement, and operate production-grade AI capabilities, evaluation services, and data pipelines; Work with product managers, domain experts, and engineers to apply validated approaches in production; Mentor technical colleagues on scientific and engineering practices.

Seniority

Senior, hands-on IC with mentorship responsibilities.