Consumer benchmark

502 real web tasks. 363 shopping carts. 139 public information tasks.

Method & data

502 tasks in this view

Historical results

Task completion

Browser Use

91.4%

459/502 tasks

Supplied reviewed result table. Different runner and browser settings remain.

43 failures, 0 policy holds, 0 unknown, 0 unstarted.

Source: Cloud workflow 39369520482; paired OpenAI workflow 39352995121

OpenAI browser runner

72.3%

363/502 tasks

Supplied reviewed result table. Different runner and browser settings remain.

139 failures, 0 policy holds, 0 unknown, 0 unstarted.

Source: Cloud workflow 39369520482; paired OpenAI workflow 39352995121

Meta Muse

61%

306/502 tasks

Muse reports evidence review. Root independently reviewed 37 original tasks, with 24 endpoints and 13 misses.

165 failures, 29 policy holds, 2 unknown, 0 unstarted.

Source: Original Muse consumer run, October 21-22, 2026

Historical V8 outcomes on the retained V9 task list. These are not fresh V9 runs or website block rates.

Runs without a final score

Instinct

12 endpoints reported, 481 tasks unstarted.

Partial

Actual result rows and archive structure verified. Original screenshot and action review remains separate.

4 failures, 5 policy holds, 0 unknown, 481 unstarted.

Progress across the planned set: 12/502 (2.4%). This is not a final score.

Instinct's stricter self-check counts 4 successes. This is a separate provider assessment.

Source: Instinct supplied v4 archive, October 23, 2026

Grok Bot

No verified matching result yet.

Pending

No matching complete result is available.

Dot

No verified matching result yet.

Pending

No matching complete result is available.

Updated Oct 23, 2026. Expand an agent for evidence and run limits.

Download results

Agents Browsers Consumer tasks

Method & data

A successful task needs the requested endpoint. An add button alone does not prove a cart.

Benchmark source

Scoring and run conditions

We recalculated historical V8 results on the retained V9 task IDs. Fleet Farm has a corrected URL and task text. These are historical projections, not new V9 executions.

Models, dates, browsers, solver rules, and evidence review differ. We selected Browser Use's best retained run. Policy holds and browser permission failures do not establish website blocks.

Bars show successful endpoint reports divided by all 502 planned tasks in this view. Missing and unstarted tasks never become website failures.

11 documented exclusions

shopee.vnduplicate shopee site

shopee.co.idduplicate shopee site

shopee.co.thduplicate shopee site

shopee.com.myduplicate shopee site

very.co.uklocal access denied

darty.comlocal access denied

webuy.comlocal access denied

snapdeal.comlocal access denied

goldapple.rulocal access denied

livemaster.rulocal access denied

buyee.jptemporary maintenance

Task manifest Full method

Original run records stay separate from task data.Synthetic design preview