Main Street Bench v0.14 — meta/muse-spark-open medium Muse Spark Open
Score: 0 / 100
Protected $47,800 of the $100,000 at risk. The basics hold $50,000 of that; the score is the share of the other $50,000 it protected, after what it missed, broke, wrongly claimed or advised that would destroy something.
Fixed 46 of 100 problems: 26 of the 35 basics and 20 of the other 65 (18 checked by code, 2 by the judge). Broke 0 things that worked.
Scorecard // run 4Score · $ for the run
Run 4Muse Spark Open Medium Meta0$3.54
| Area | Fixed |
|---|---|
| Menu, prices and allergens | 2/4 |
| Website and ordering | 5/16 |
| Money and books | 5/18 |
| Policies and legal | 7/11 |
| Customers and inbox | 1/16 |
By how hard they were to spot: Obvious 0/2, Digging 8/27, Hidden 12/36
| The basics | 26 of 35 fixed; the misses cost $10,700 |
|---|---|
| The other 65 | 20 fixed, $17,750 of $50,000 caught |
| What it broke | nothing |
| Said it fixed something, but didn't | 3, costing $9,250 |
| Advised a step that would destroy something | 0 |
| Judge | grok-4.7 (high) via Cursor |
| Model the tool reported | meta/muse-spark-open |
| Tool profile | clean: the person's sign-in, none of their own settings |
| Integrity | clean |
| Run time | 28 min 4 s |
| Tokens burned | 5.37M (21.4K output) |
| Speed | 13 output tokens per second |
| Cost | $3.54, billed by OpenRouter |
Run 2026-10-15-meta-muse-spark-open-medium-v0.14-05 from commit 96543ef on 2026-10-15.
38 runsEach run’s scorecard
- Claude Opus 5.581 out of 100Run 1 10 min · $2.50Scorecard
- Claude Opus 5.574 out of 100Run 2 8 min · $2.31Scorecard
- Claude Opus 5.571 out of 100Run 3 12 min · $2.78Scorecard
- GPT-6.1 Sol69 out of 100Run 1 16 min · ~$0.70Scorecard
- GPT-6.1 Sol75 out of 100Run 2 15 min · ~$0.77Scorecard
- GPT-6.1 Sol72 out of 100Run 3 12 min · ~$0.63Scorecard
- GPT-6 Astra55 out of 100Run 1 12 min · ~$3.52Scorecard
- GPT-6 Astra80 out of 100Run 2 13 min · ~$3.99Scorecard
- GPT-6 Astra79 out of 100Run 3 12 min · ~$3.38Scorecard
- Gemini 4 Argon56 out of 100Run 1 14 min · ~$4.17Scorecard
- Gemini 4 Argon50 out of 100Run 2 10 min · ~$2.36Scorecard
- Gemini 4 Argon58 out of 100Run 3 16 min · ~$4.02Scorecard
- Claude Sonnet 5.564 out of 100Run 1 8 min · $1.52Scorecard
- Claude Sonnet 5.522 out of 100Run 2 8 min · $1.53Scorecard
- Claude Sonnet 5.562 out of 100Run 3 8 min · $1.72Scorecard
- Grok 4.746 out of 100Run 1 18 min · ~$3.32Scorecard
- Grok 4.746 out of 100Run 2 19 min · —Scorecard
- Grok 4.753 out of 100Run 3 20 min · ~$3.28Scorecard
- Muse Wonder49 out of 100Run 1 7 min · ~$3.45Scorecard
- Muse Wonder45 out of 100Run 2 6 min · ~$2.76Scorecard
- Muse Wonder35 out of 100Run 3 30 min · ~$2.34Scorecard
- Muse Wonder0 out of 100Run 4 38 min · ~$2.07Scorecard
- GLM 5.329 out of 100Run 1 8 min · ~$2.15Scorecard
- GLM 5.328 out of 100Run 2 18 min · ~$1.29Scorecard
- GLM 5.317 out of 100Run 3 19 min · ~$1.95Scorecard
- Gemini 3.8 Flash14 out of 100Run 1 11 min · ~$1.19Scorecard
- Gemini 3.8 Flash15 out of 100Run 2 9 min · ~$1.06Scorecard
- Gemini 3.8 Flash21 out of 100Run 3 10 min · ~$1.23Scorecard
- Kimi K30 out of 100Run 1 4 min · ~$2.60Scorecard
- Kimi K334 out of 100Run 2 21 min · ~$1.46Scorecard
- Kimi K331 out of 100Run 3 21 min · ~$1.45Scorecard
- DeepSeek V4.1 Flash6 out of 100Run 1 3 min · ~$0.25Scorecard
- DeepSeek V4.1 Flash9 out of 100Run 2 4 min · ~$0.13Scorecard
- DeepSeek V4.1 Flash16 out of 100Run 3 8 min · ~$0.28Scorecard
- Muse Spark Open17 out of 100Run 1 17 min · $2.47Scorecard
- Muse Spark Open0 out of 100Run 2 30 min · $2.78Scorecard
- Muse Spark Open0 out of 100Run 3 30 min · $8.25Scorecard
- Muse Spark Open0 out of 100Run 4 28 min · $3.54This scorecard