SDE-II, AI Core Infra - AI Analytics and Insights
Core
Designing, building, and scaling backend services and infrastructure for a conversational AI assistant (SpektrBot) that enables data engineers and analysts to query advertising data lakes via natural language.
Role type
Senior IC SDE II (AI Core Infra)
Builds
Scalable conversational AI platform, RAG pipelines, LLM integration layers, SQL generation tools, and automated evaluation systems.
Domain
Generative AI, Data Engineering, Advertising Technology
Deliverable
production ML models | product features | infrastructure
Required skills
Large-scale distributed systems design, RAG architecture, LLM integration and orchestration, SQL generation and validation, automated evaluation loop design, metadata curation tooling, multi-agent system design
Preferred skills
Full SDLC ownership, C#/C++/Java/Perl proficiency, Object-Oriented Design
Technologies
LLMs, Vector stores, Embedding pipelines, SQL generation engines, Multi-agent orchestration frameworks
Responsibilities
Architect robust backend services for query orchestration and session handling; Engineer RAG architectures including retrievers and metadata indexing; Integrate and operationalize LLMs with prompt management and chain-of-thought workflows; Build automated evaluation and feedback loops for response accuracy; Develop SQL generation and validation pipelines with guardrails; Create LLM-powered tools for metadata auto-curation; Collaborate with scientists to productionize NLP/NLU models; Own systems end-to-end from design to operational excellence.
Seniority
Senior, hands-on IC
