Machine Learning Engineer - My OPSWAT Portal
Core
Build and integrate AI/LLM features (RAG, agents, search) into the My OPSWAT Portal platform to improve accuracy, latency, and security for customers and partners.
Role type
Senior IC Machine Learning Engineer (LLM/RAG)
Builds
AI-powered features for a customer portal managing licenses, support, and cloud services
Domain
Cybersecurity / IT Infrastructure
Deliverable
production ML models
Required skills
Python, RAG, Prompt Engineering, Embeddings, Vector Databases, LLM Evaluation, REST APIs, SQL/No-SQL, Docker, CI/CD, LLM serving (vLLM, Ollama), Inference optimization
Preferred skills
Fine-tuning open-weight LLMs, Agent frameworks, LLM security (prompt injection prevention), On-premises model deployment, Evaluation tooling (LLM-as-judge)
Technologies
vLLM, Ollama, OpenAI, Anthropic, Azure OpenAI, Docker, Git
Responsibilities
Develop and integrate RAG, AI agents, and recommendation systems; Build and maintain data ingestion and evaluation pipelines; Collaborate with DevOps to deploy and monitor self-hosted LLMs; Design and run model evaluations for non-deterministic systems
Seniority
Senior, hands-on IC