Software Engineer - Data Science & AI
Core
Build and maintain backend services, APIs, and agentic components for a reusable AI platform, implementing RAG features and supporting LLM evaluation.
Role type
Senior IC software engineer (AI/LLM platform)
Builds
Reusable AI platform components, RAG pipelines, agent frameworks, and evaluation suites
Domain
Artificial Intelligence, Large Language Models, Information Retrieval
Deliverable
production ML models
Required skills
Python, SQL, LLM APIs, Prompt Engineering, RAG, Orchestration Frameworks (LangGraph/LangChain/LlamaIndex), Cloud Platforms (Azure/AWS/GCP), Containerization, Machine Learning Concepts (Embeddings/Evaluation/NLP)
Preferred skills
C#, Java, Go, TypeScript, .NET, Elasticsearch, pgvector, Azure AI Search, Kubernetes, CI/CD Tools (GitHub Actions/Azure DevOps), Evaluation Libraries (Ragas/DeepEval/promptfoo/LangSmith/Langfuse)
Technologies
LangGraph, LangChain, LlamaIndex, Azure, AWS, GCP, Kubernetes, Elasticsearch, pgvector, Azure AI Search, GitHub Actions, Azure DevOps, Ragas, DeepEval, promptfoo, LangSmith, Langfuse
Responsibilities
Build and maintain backend services, APIs, and agentic components; Implement RAG features including data ingestion, chunking, indexing pipelines, and search integration; Contribute to agent frameworks, skills, and tool registries; Add logging, tracing, cost and token telemetry, and automated tests; Support LLM evaluation through golden datasets, LLM-as-judge pipelines, regression suites, and quality reporting; Assist with ranking, retrieval, and prompt experiments; Document components for consuming teams
Seniority
Mid-Senior, hands-on IC
