Agent Architect
Core
Designing the multi-agent architecture and logic for a Generative AI SaaS platform that powers content creation for advertising agencies and brands.
Role type
Senior IC Agent Architect (Systems Design)
Builds
Multi-agent workflows, evaluation frameworks, and reusable agent libraries for the Pencil creative engine.
Domain
Advertising Technology / Generative AI / Multi-Agent Systems
Deliverable
production ML models
Required skills
Multi-agent workflow design, task decomposition, state management, tool-use integration (RAG, APIs), evaluation framework implementation (LLM-as-a-judge, promptfoo, DSPy), Python, API documentation, client-facing problem decomposition, plain-language technical communication.
Preferred skills
Experience with LLMs (GPT-4, Claude, Gemini), multimodal models (Stable Diffusion, Midjourney, Video Gen), solutions architecture, technical consulting.
Technologies
Python, JSON, RAG, promptfoo, DSPy, LLM-as-a-judge
Responsibilities
Design and implement multi-agent workflows including task decomposition and tool-use; develop rigorous evaluation frameworks to measure agent performance; create reusable agents and prompt libraries for scaling to 1,000+ brands; partner with engineering teams to determine behaviors for prompting, RAG, or fine-tuning; lead discovery sessions with clients to decompose business problems into buildable agent workflows.
Seniority
Senior, hands-on IC
