Software Development Engineer, Amazon Search Navigation AI
Core
Build and operate large-scale, distributed, low-latency services powering Amazon Search Navigation experiences, including real-time LLM inference and conversational refinement systems.
Role type
Senior Software Development Engineer (Search Navigation & LLM Serving)
Builds
Search Navigation platform, Navigation Experience Service (NES), Smart Refinement, multi-turn conversational refinement
Domain
E-commerce, Search, Generative AI, Large Language Models
Deliverable
production ML models
Required skills
Distributed systems design, Low-latency service architecture, LLM inference optimization, Data pipeline engineering, A/B experimentation, Object Oriented Design, C#/C++/Java/Perl
Preferred skills
GPU/Neuron/TPU deployment, Machine Learning fundamentals, Information retrieval, Natural language processing
Technologies
C#, C++, Java, Perl, LLMs, GPUs, Neuron, TPU
Responsibilities
Design and operate large-scale distributed services; Build and optimize online LLM serving; Integrate models into production systems; Build scalable data pipelines; Run and analyze online A/B experiments; Ensure operational excellence for critical services
Seniority
Senior, hands-on IC