SMB AI Power User — Competitive Evaluations
Core
Evaluate AI assistants against real-world small and medium-sized business needs by running head-to-head prompts and documenting failure modes in marketing, customer communication, and operations.
Role type
Independent contractor AI evaluation specialist (SMB focus)
Builds
Reproducible evaluation reports and a library of practical SMB test cases
Domain
Generative AI product evaluation / Small business operations
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery
Required skills
Daily heavy usage of generative AI tools, hands-on management of Instagram/Facebook business presence, practical experience creating and optimizing paid Meta ad campaigns, exceptional written English for technical reporting, strong analytical and observational skills
Preferred skills
Experience with paid AI subscriptions (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced), familiarity with AI automations and no-code integrations, previous experience in model evaluation or QA, familiarity with SMB tools (Shopify, QuickBooks, Canva)
Technologies
Meta platforms (Instagram, Facebook, Ads Manager), ChatGPT, Claude, Gemini, Shopify, QuickBooks, Canva, CapCut, Later
Responsibilities
Run multi-turn workflows across competing AI assistants, identify and document specific failure modes (inaccuracies, refusals, tone issues), produce detailed evaluation reports with prompts and results, compare value of bundled vs. competing paid AI subscriptions, maintain weekly delivery cadence
Seniority
Independent contractor, output-focused
