AI Software Engineer - Winnipeg
Core
Human-in-the-loop training and evaluation of advanced AI agents and large language models to improve their ability to execute complex, multi-step real-world workflows.
Role type
AI Software Engineer (Human Feedback & Evaluation)
Builds
Proactive, multi-step AI agents and generative systems
Domain
Artificial Intelligence / Large Language Models / Agent Orchestration
Deliverable
production ML models
Required skills
Backend engineering, AI automation, complex systems integration, Python, JavaScript, Go, Java, SQL, live environment development, multi-step system interaction management, agent-tool integration (APIs), session tracking, privacy/security analysis
Preferred skills
Experience with Supabase, Gmail APIs, MEMORY.md state management, prompt injection detection
Technologies
Java, JavaScript, Python, SQL
Responsibilities
Provide human feedback to train advanced AI systems, support development of large language models acting as proactive agents, evaluate intricate system behavior and surface failures or risks, collaborate with leading AI organizations on generative systems, contribute to projects teaching systems to design and coordinate complex architectural workflows, identify and surface risks in agent behavior to improve reliability and safety