AbMaze v0.3 results

Overall score

Score by task

Every run

Hollow = refused · outlined = credits ran out

Hits vs. hit quality

How runs ended

Search progress

Best true score measured so far · dashed = scripted

Cost

API cost per run vs. score · dashed = scripted

Paired vs. Bayesian optimization

Filled = 95% CI excludes 0

Claude Opus 5.5 was evaluated with access through Anthropic's Life Sciences Verification Program (LSVP).

Model settings: Gemini 4 (gemini-4-argon, thinking level high), Claude Opus 5.5 (effort high), GPT-6 Astra (reasoning effort high), Qwen3.8-max-prime (reasoning effort high, via OpenRouter, Alibaba provider), Grok 4.7 (reasoning effort high, via OpenRouter, xAI provider).