SMB AI Power User — Competitive Evaluations
Core
Evaluate generative AI assistants against real-world small and medium-sized business workflows, identifying failure modes and comparing value across competing tools.
Role type
Independent contractor AI evaluation specialist (SMB focus)
Builds
Structured evaluation reports, test case libraries, and comparative analysis of AI tool performance for paying business users.
Domain
Generative AI product evaluation / Small and medium-sized business operations
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure | physical/clinical work
Required skills
hands-on SMB operations, daily generative AI usage, Meta advertising management, social media content creation, English technical writing, analytical observation
Preferred skills
paid AI subscription experience, multi-assistant comparison, AI automation/API familiarity, SMB tool proficiency, prior model evaluation experience
Technologies
ChatGPT, Claude, Gemini, Meta Ads, Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later
Responsibilities
Run head-to-head prompts and multi-turn workflows across AI assistants, build and maintain a library of practical SMB test cases, test AI capabilities across social media and commerce environments, identify and document failure modes, produce clear reproducible evaluation reports, compare value of bundled AI subscriptions vs competing paid assistants
Seniority
Independent contractor, output-focused
