Staff Machine Learning Engineer - Integrations & Solutions Group (AU remote)

## Responsibilities - Drive the design and evolution of AI-ready tools and APIs that enable LLM platforms (ChatGPT, Claude, Gemini and others) to reliably interact with Canva's design capabilities — defining the patterns and standards that other teams adopt for tool descriptions, payload structures, and intent-based interfaces. - Pioneer agent-to-agent communication approaches. - Own and evolve evaluation frameworks that systematically measure tool-use accuracy across platforms — defining what "good" looks like for proxy-based fast evals and real-client production evals, and ensuring these frameworks scale as we add platforms and capabilities. - Shape Canva's agent architecture — making strategic technical decisions about where intelligence should live (in external LLMs vs Canva-hosted agents), building the orchestration layers that allow third-party providers to invoke Canva's design tools at scale, and driving automation of complex workflows like marketing campaigns. - Define and build observability systems that give multiple teams visibility into how AI assistants consume Canva's tools in production — identifying failure patterns, setting quality benchmarks, and closing the loop between production data and continuous improvement. - Work across team and platform boundaries — proactively identifying problems not yet defined, understanding behavioural quirks across LLM platforms, and driving solutions that span the AI Integrations, API Capabilities, and Workflow Integrations teams. - Influence integration strategy with AI partners and internal teams — contributing to technical direction with OpenAI, Anthropic, and Google, and shaping how Canva's broader engineering organisation builds for AI consumption. ## Requirements - You've shipped LLM-powered systems into production and can quantify your impact — things like improving tool-call accuracy from X% to Y%, reducing agent error rates, cutting latency by Z%, or measurably improving user outcomes through better AI integration. - We care about results, not just launches. - You proactively find and solve problems others haven't defined yet — you've identified gaps in how LLMs consume tools or APIs, scoped the problem across teams, and driven the fix without waiting for someone to hand you a brief. - You've built or owned evaluation pipelines end-to-end — designing metrics, building benchmarking infrastructure, and using data to make architectural decisions about AI integrations at scale. - You set technical standards that others follow — whether that's tool design patterns, API contracts for AI agents, documentation quality, or observability practices. - Your work becomes the reference point. - You can connect external ecosystem changes to internal strategy — when a new LLM capability drops or a partner shifts their architecture, you can quickly assess the implications for Canva and re-prioritise accordingly. - You're proficient in Python and familiar with ML frameworks, and equally comfortable working with TypeScript/Node.js and cloud infrastructure (Cloudflare Workers, AWS, or similar). - You thrive in cross-team, partner-facing work — influencing engineering, product, and external AI platform teams to shape integration strategy. ## Nice to Have - Not explicitly mentioned in the description. ## Benefits - Remote-friendly within Australia. - Flexibility in how and where you work — whether that's from one of our spaces, from home, or a mix of both. - Opportunity to work with leading AI partners like OpenAI, Anthropic, and Google. - Contribution to shaping the future of AI integration in design platforms. - Collaborative environment with cross-functional teams.