Senior AI Scientist - SAP Globalization AI
Core
Lead scientific methodology, evaluation standards, and production implementation for generative AI, RAG, and agentic systems within enterprise localization.
Role type
Senior AI Scientist (Applied AI & Evaluation)
Builds
Production-grade AI capabilities, evaluation services, data pipelines, and benchmarks for generative AI, RAG, and agentic workflows.
Domain
Enterprise Software / AI / Localization
Deliverable
production ML models
Required skills
Python, Applied Statistics, Machine Learning, Deep Learning, NLP, Information Retrieval, LLM applications, RAG, Embeddings, Semantic Retrieval, Agentic workflows, Evaluation dataset design, Statistical significance analysis, Root cause analysis, CI/CD, Cloud deployment, API development, Automated testing, LLM-as-a-judge methods, Hybrid search, Reranking, Model selection, Agent architectures, Monitoring (quality, drift, latency, cost), Mentorship.
Preferred skills
Master's degree or PhD in CS/AI/ML/Data Science/Statistics, Experience with SAP Globalization context.
Technologies
Python, LLMs, RAG frameworks, Embedding models, Cloud platforms, CI/CD tools, Automated testing frameworks.
Responsibilities
Define hypotheses, baselines, success metrics, and acceptance criteria for AI systems; Develop benchmarks and evaluation methods covering retrieval quality, grounding, factual consistency, safety, and task completion; Perform systematic error analysis to trace failures to root causes in data, retrieval, ranking, context, prompts, models, tools, or agent orchestration; Research and evaluate embeddings and hybrid search using controlled experiments; Design, implement, and operate production-grade AI capabilities, evaluation services, and data pipelines; Work with product managers, domain experts, and engineers to apply validated approaches in production; Mentor technical colleagues on scientific and engineering practices.
Seniority
Senior, hands-on IC with mentorship responsibilities.
