/ github.com / gke-labs / eval-runner

pr-391-b3-base Completed

← Back to Runs
Repository
https://github.com/gke-labs/eval-runner.git
Commit
0a3e6b0
Model
google/gemini-3.5-flash-lite
Age
4h
Tasks
1/1 (1 ok, 0 fail)
Total Samples
5 (samples 17-24)
Mean Success Rate
0.40
Artifacts
gs://gkelabs-evalrunner-dev-eval-runner/runs/0a3e6b01043cf8c6eaebcb676001a692ab71c350/
Total Cost
$0.0014
Tokens Consumed
1159
Latency (mean of per-task p50 / p95)
2.32s / 5.03s

Eval Tasks

View: All Metrics Accuracy / Rate Latency (p50/p95) Tokens Cost ($ USD)
eval phase rate 95% CI (0-1 axis) n method log path
docs/readme_comprehension_blind Completed 0.40 [0.12, 0.77]
2/5 (samples 17-24) wilson gs://gkelabs-evalrunner-dev-eval-runner/runs/0a3e6b01043cf8c6eaebcb676001a692ab71c350/docs/readme_comprehension_blind/2026-10-27T15-48-05-00-00_readme-comprehension-blind_2maDy5dnGgdEjhysiPzUxu.json ↗
artifacts: gs://gkelabs-evalrunner-dev-eval-runner eval-runner 369fe00d3cd14b7fcab13efa8fa2934429d4ae27