0.56
[0.33, 0.77]
Eval Suites
branch: main| Suite / Eval | Score (95% CI) | Evals | Δ vs prev | Trend |
|---|---|---|---|---|
| docs | 0.56 [0.33, 0.77] | 2 | — | |
| docs/readme_comprehension | 1.00 [0.68, 1.00] | — | — | |
| docs/readme_comprehension_blind | 0.12 [0.02, 0.47] | — | — |
Score at main for an eval is the pooled success rate (Wilson score interval) over the newest completed baseline observations on
main. Suite scores are the mean of their evals' scores with the confidence interval from pooled samples. Overall score is the mean over suites.