Sr. Applied Scientist, Agent Evaluation and Experimentation, DTx Science
Core
Lead agent evaluation, impact measurement, and experimentation for generative AI and agentic solutions to improve the advertiser experience on Amazon Ads Console.
Role type
Senior Applied Scientist (Agent Evaluation & Experimentation)
Builds
Agent evaluation frameworks, impact measurement tools, and experimentation pipelines for ad consoles.
Domain
Advertising technology, Generative AI, Agentic AI
Deliverable
production ML models
Required skills
Machine learning, Neural deep learning, Causal inference, Reinforcement learning, Natural language processing, Generative AI, Agent evaluation, Experimentation design, High-ambiguity project leadership, Mentoring
Preferred skills
Large scale distributed systems, Modeling tools (R, scikit-learn, Spark MLLib, MxNet, Tensorflow, numpy, scipy)
Technologies
Java, C++, Python, Spark, Hadoop, Tensorflow, MxNet, numpy, scipy
Responsibilities
Lead development of agent evaluation and impact measurement solutions; Drive adoption of state-of-the-art scientific technologies; Translate complex scientific challenges into business solutions; Mentor junior scientists; Engage with the broader scientific community through publications and patents.
Seniority
Senior, hands-on IC with mentorship responsibilities