Browser Use Bench v2.1 | 180 tasks | October 17, 2026

DeepSeek V4.1 Flash 1017 on real browser tasks.

#3 of 22 at max effort. No other model in the test scores higher for less.

Run October 17, 2026 on the DeepSeek API. Cost is at peak rates (off-peak is half) and about 0.1% of calls reported no usage, so it is a slight lower bound. It ran on different CI runners from the rest of the lineup, so its times are not comparable.

Score75.0
Cost / task22¢
Median time17 min
#ModelScoreCost / task
3DeepSeek V4.1 Flash 1017 max75.022¢
6DeepSeek V4.1 Flash 1017 low74.012¢
7DeepSeek V4.1 Flash 1017 high73.615¢

180 long tasks on live websites, the same for every model, run in the open-source BrowserCode harness (Browser Use's own agent runs in ours). Mean weighted rubric score per task, 0-100. Estimated model cost per task in USD. Excludes search, judge, browser and runner costs. Runner and encrypted tasks: github.com/browser-use/benchmark.