pr-395-4ea4529 Completed

Repository

https://github.com/codebot-robot/eval-runner.git

Commit

4ea4529

Model

google/gemini-3.5-flash-lite

Age

Tasks

2/2 (2 ok, 0 fail)

Total Samples

16 (samples 1-8)

Mean Success Rate

0.56

Artifacts

Total Cost

$0.0189

Tokens Consumed

54863

Latency (mean of per-task p50 / p95)

2.42s / 2.94s

Eval Tasks

All Metrics Accuracy / Rate Latency (p50/p95) Tokens Cost ($ USD)

eval	phase	latency (p50/p95)	n	log path
docs/readme_comprehension	Completed	2.44s / 2.65s	8/8 (samples 1-8)	gs://gkelabs-evalrunner-dev-eval-runner/runs/4ea452974d0d3cfb5ae35ce61c730e2c976d04ce/docs/readme_comprehension/2026-10-27T17-43-13-00-00_readme-comprehension_PmjK7drVkvtEo93Kg7GCfa.json ↗
docs/readme_comprehension_blind	Completed	2.41s / 3.23s	1/8 (samples 1-8)	gs://gkelabs-evalrunner-dev-eval-runner/runs/4ea452974d0d3cfb5ae35ce61c730e2c976d04ce/docs/readme_comprehension_blind/2026-10-27T17-43-49-00-00_readme-comprehension-blind_cRmgkYDom5MVJyoqZ3kcPL.json ↗

artifacts: gs://gkelabs-evalrunner-dev-eval-runner eval-runner 369fe00d3cd14b7fcab13efa8fa2934429d4ae27