AI Developer
Core
Building and operating LLM-powered systems including serving open-source models, building RAG pipelines, and developing MCP integrations.
Role type
hands-on AI developer (LLM engineering)
Builds
production-grade LLM inference services, RAG pipelines, and MCP integrations connecting models to tools and data
Domain
Artificial Intelligence / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, LLM serving (Ollama, llama.cpp), RAG pipelines, MCP integrations, Docker, CI/CD, Azure, AWS, Kafka, data parsing (XML/XSD, Office formats)
Preferred skills
GPU/CUDA tuning, model quantization (GGUF), Terraform, Kubernetes, Go, Rust, C++, Prometheus, Grafana, DevSecOps
Technologies
Ollama, llama.cpp, Azure, AWS, Docker, Kafka, Python, Bash, PowerShell, Terraform, Kubernetes, Prometheus, Grafana
Responsibilities
Serve and operate open-source LLMs locally and on-prem; Build and maintain RAG pipelines with embeddings and vector databases; Develop MCP integrations connecting LLMs to internal tools; Build backend services in Python for ML inference; Parse structured and semi-structured data; Build and maintain CI/CD pipelines for AI services; Deploy AI workloads to cloud providers and containerize services; Automate operational tasks with scripting; Troubleshoot across the stack; Support event-driven architectures using Apache Kafka
Seniority
Mid-level, hands-on IC