pr-391-b3-base Completed

Repository

https://github.com/gke-labs/eval-runner.git

Commit

0a3e6b0

Model

google/gemini-3.5-flash-lite

Age

Tasks

1/1 (1 ok, 0 fail)

Total Samples

5 (samples 17-24)

Mean Success Rate

0.40

Artifacts

Total Cost

$0.0014

Tokens Consumed

1159

Latency (mean of per-task p50 / p95)

2.32s / 5.03s

Eval Tasks

All Metrics Accuracy / Rate Latency (p50/p95) Tokens Cost ($ USD)

eval	phase	latency (p50/p95)	n	log path
docs/readme_comprehension_blind	Completed	2.32s / 5.03s	2/5 (samples 17-24)	gs://gkelabs-evalrunner-dev-eval-runner/runs/0a3e6b01043cf8c6eaebcb676001a692ab71c350/docs/readme_comprehension_blind/2026-10-27T15-48-05-00-00_readme-comprehension-blind_2maDy5dnGgdEjhysiPzUxu.json ↗

artifacts: gs://gkelabs-evalrunner-dev-eval-runner eval-runner 369fe00d3cd14b7fcab13efa8fa2934429d4ae27