Skip to main content
CodingAgentBench

Pairwise effects · 95% CI · BH-FDR

Which differences are real

Two CLIs can look different on the leaderboard and still be a coin flip. We test every pair and tell you which gaps survive.

What this page is

  • What you'll find: the three sharpest head-to-head gaps we can defend with statistics, not vibes.
  • Who it's for: people choosing between two CLIs and asking "is the difference real."
  • How to go deeper: switch to Nerds mode for the full forest plot of every pairwise comparison.

The three sharpest gaps

Back to the leaderboard

Fork-lineage DAG

Forest

10 roots · 0 forks

Every first-party TUI CodingAgentBench tracks is a tree root. Community forks attach as branches, indexed by lineage from their parent SHA. Each fork carries a paired-bootstrap Δ-PBS against its parent, an AST-divergence measurement, and an admission tier (T0 Sniff → T3 Champion). Submission details live on the Submit page.

T0 · Sniff 0
T1 · Quarantine 0
T2 · Public 0
T3 · Champion 0

The forest is empty

No community forks have been admitted yet. The first valid submission becomes root of its lineage.

Be the first to submit a fork
Legend. Δ-PBS chips show paired-bootstrap mean against parent with 95% CI in parentheses. AST ribbon width is mean AST divergence, capped at 100%. Bands: patch < 5%, branch 5–25%, hard > 25%.