CareerPlan

AI Developer

RemoteFull-time2026-11-07 → 2026-11-09

Core

Building and operating LLM-powered systems including serving open-source models, building RAG pipelines, and developing MCP integrations.

Role type

hands-on AI developer (LLM engineering)

Builds

production-grade LLM inference services, RAG pipelines, and MCP integrations connecting models to tools and data

Domain

Artificial Intelligence / Large Language Models / Cloud Infrastructure

Deliverable

production ML models

Required skills

Python, LLM serving (Ollama, llama.cpp), RAG pipelines, MCP integrations, Docker, CI/CD, Azure, AWS, Kafka, data parsing (XML/XSD, Office formats)

Preferred skills

GPU/CUDA tuning, model quantization (GGUF), Terraform, Kubernetes, Go, Rust, C++, Prometheus, Grafana, DevSecOps

Technologies

Ollama, llama.cpp, Azure, AWS, Docker, Kafka, Python, Bash, PowerShell, Terraform, Kubernetes, Prometheus, Grafana

Responsibilities

Serve and operate open-source LLMs locally and on-prem; Build and maintain RAG pipelines with embeddings and vector databases; Develop MCP integrations connecting LLMs to internal tools; Build backend services in Python for ML inference; Parse structured and semi-structured data; Build and maintain CI/CD pipelines for AI services; Deploy AI workloads to cloud providers and containerize services; Automate operational tasks with scripting; Troubleshoot across the stack; Support event-driven architectures using Apache Kafka

Seniority

Mid-level, hands-on IC