SMB AI Power User — Competitive Evaluations
Core
Evaluate generative AI assistants against real-world small and medium-sized business workflows by running head-to-head tests, documenting failure modes, and producing reproducible evaluation reports.
Role type
Independent contractor competitive AI evaluator (SMB focus)
Builds
Structured evaluation reports and test case libraries for AI product teams
Domain
Generative AI evaluation / Small and medium-sized business operations
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery
Required skills
Daily heavy usage of generative AI tools, hands-on management of Instagram/Facebook business presence, practical experience creating and optimizing paid Meta ad campaigns, exceptional written English, strong analytical and observational skills, ability to work independently
Preferred skills
Experience with paid AI subscriptions (ChatGPT Plus/Pro, Claude Pro/Max, Gemini Advanced), experience using multiple AI assistants simultaneously, familiarity with AI automations/agents/APIs/no-code integrations, previous experience in model evaluation/red teaming/data annotation, familiarity with SMB tools (Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later)