/ github.com / codebot-robot / eval-runner

pr-391-b2-cand Completed

← Back to Runs
Repository
https://github.com/codebot-robot/eval-runner.git
Commit
184dfbc
Model
google/gemini-3.5-flash-lite
Age
3h
Tasks
1/1 (1 ok, 0 fail)
Total Samples
8 (samples 9-16)
Mean Success Rate
0.12
Artifacts
gs://gkelabs-evalrunner-dev-eval-runner/runs/184dfbc73f5a4c073be67666fc2bde04710a9e07/
Total Cost
$0.0020
Tokens Consumed
1627
Latency (mean of per-task p50 / p95)
2.40s / 3.61s

Eval Tasks

View: All Metrics Accuracy / Rate Latency (p50/p95) Tokens Cost ($ USD)
eval phase rate 95% CI (0-1 axis) latency (p50/p95) tokens cost n method log path
docs/readme_comprehension_blind Completed 0.12 [0.02, 0.47]
2.40s / 3.61s 1627 $0.0020 1/8 (samples 9-16) wilson gs://gkelabs-evalrunner-dev-eval-runner/runs/184dfbc73f5a4c073be67666fc2bde04710a9e07/docs/readme_comprehension_blind/2026-10-27T15-47-11-00-00_readme-comprehension-blind_UMdSivNg9NXotZhqUo7mSV.json ↗
artifacts: gs://gkelabs-evalrunner-dev-eval-runner eval-runner 369fe00d3cd14b7fcab13efa8fa2934429d4ae27