All benchmark results

Etsy automation benchmark

Search for a USB-C cable and verify one product in the cart.

Dot reports an unusual-activity restriction on search. A restriction can stop a task without an interactive CAPTCHA.

One task in the 500-task selection · consumer-0005

Browser Use Cloud

Oct 20, 2026

The cart shows one blue, 1M USB-C cable. No CAPTCHA appeared.

CAPTCHA report: none

Success

1/1 task

Dot

Oct 20, 2026

Search showed an unusual-activity restriction. No interactive CAPTCHA appeared.

CAPTCHA report: none

Failure

0/1 task

Meta Muse

Oct 21–22, 2026

Muse reports this outcome. Original parallel action evidence remains incomplete.

CAPTCHA report: not reported

Success

1/1 task

Instinct

Oct 23, 2026 snapshot

The source table reports this task outcome.

CAPTCHA report: not reported

Policy hold

Grok Bot

Oct 12–13, 2026

Separate 50-site browsing study. It requires a product or result page, not a verified cart.

CAPTCHA report: not comparable

Success

Each result describes one historical attempt. Different dates, models, and challenge rules limit direct comparison.

Original browser evidence

Etsy CAPTCHA and checkout automation

A CAPTCHA encounter does not always stop a browser agent. Automatic clearance and final task completion need separate records.

This benchmark tests public browsing and cart verification. It stops before checkout. It does not measure purchases or completed checkout automation.

A request error, login requirement, or browser permission failure does not establish a website bot block.