All benchmark results

Amazon automation benchmark

Open a public Amazon product page.

This older smoke task differs from the 500-task benchmark. It does not measure Amazon cart or checkout automation.

Separate historical browsing study · Outside the 500-task selection

Grok Bot

Oct 12–13, 2026

Separate 50-site browsing study. It requires a product or result page, not a verified cart.

CAPTCHA report: not comparable

Success

Each result describes one historical attempt. Different dates, models, and challenge rules limit direct comparison.

Original browser evidence

Amazon CAPTCHA and checkout automation

A CAPTCHA encounter does not always stop a browser agent. Automatic clearance and final task completion need separate records.

This benchmark tests public browsing and cart verification. It stops before checkout. It does not measure purchases or completed checkout automation.

A request error, login requirement, or browser permission failure does not establish a website bot block.