Senior AI Software Engineer – Agentic AI System
Core
Build infrastructure, tooling, and integrations for an end-to-end evaluation platform for agentic AI frameworks, spanning deployment orchestration, data pipelines, observability, and model serving.
Role type
Senior AI Software Engineer (Agentic AI Systems)
Builds
Deployment orchestration workflows, data pipelines, observability tools, dashboards, and model serving/benchmarking tooling for AI agent frameworks.
Domain
Artificial Intelligence / Agentic Systems / Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Software engineering fundamentals, Python/C++/TypeScript/RUST/Go, containerized development (Docker, Linux), REST APIs, SQL, AI agents/LLMs/modern AI infrastructure
Preferred skills
CI/CD systems, SSH/multi-host orchestration, data visualization tools, model serving tools (Ollama, llama.cpp, vLLM), prompt engineering, messaging platform APIs, infrastructure-as-code, performance profiling, open-source agent frameworks
Technologies
Docker, Linux, Python, C++, TypeScript, RUST, Go, SQL, REST, GitHub Actions, Jenkins, Chart.js, D3, Grafana, Ollama, llama.cpp, vLLM, Anthropic API, Terraform, Ansible
Responsibilities
Design and implement deployment and orchestration workflows for distributed AI systems; Build data pipelines, observability tools, dashboards, and reporting systems; Integrate and evaluate agent frameworks and LLM-based systems; Develop tooling for model serving, benchmarking, and performance evaluation; Collaborate across teams and with external framework engineers
Seniority
Senior, hands-on IC