Agency
SMB AI Power User — Competitive Evaluations
World Wide - Remote. Posted a month ago
The role
You will run head-to-head prompts and workflows across competing AI assistants using tasks from your own business operations. You will identify failure modes and write reproducible reports to assess the value of a bundled subscription compared to standalone competitors.
What you will do
- Run head-to-head prompts and multi-turn workflows across the client's assistant and competing paid assistants
- Build and maintain a library of realistic small-business test cases
- Identify and document failure modes
- Write clear, reproducible reports
- Assess the bundled subscription on value terms
- Stress-test assistant features inside social and commerce surfaces
Required qualifications
- Owner or operator of a small or medium business of roughly 1–200 employees
- Daily, habitual use of generative AI tools in that business for operations and marketing
- Organic presence on Instagram and Facebook for the business, maintained personally
- Hands-on paid advertising experience on Meta platforms
- Based in the United States and authorized to work here
- Capacity sufficient to complete deliverables per the agreed scope and timeline
- Exceptional written English
- Comfortable working independently against a rubric and holding a weekly output cadence
Nice to have
- At least one current paid AI subscription
- Runs a side business or second venture alongside a primary role
- Heavy Instagram user, personally and commercially
- Subscribes to two or more AI assistants simultaneously
- Uses AI beyond chat
- Prior experience with model evaluation, red teaming, data annotation, QA, or structured user research
- Working familiarity with adjacent SMB tooling: Shopify, Square, QuickBooks, Klaviyo, Canva, CapCut, Later, or similar
- Industry range across the two hires
Before you apply
- Based in the United States and authorized to work here
About the company
Meridial places skilled, remote-first professionals into high-trust, high-precision operational opportunities for leading technology companies.