JevBench v1.5.2 · individual system
JevK5 v0.3 (4B)
Unclassified · Author not recorded · Openness: unknown
v1.5 roster addendum A1
not recorded
JevBench v1.5.2 score
71.898
Option A: rank #4 of 99 ranked systems.
The three option scores and ranks are published independently; the headline is Option A.
| Option | Score | Rank |
|---|---|---|
| A · headline | 71.898 | #4 of 99 |
| B | 68.115 | #5 of 99 |
| C | 63.238 | #8 of 99 |
Published axes
- intelligence
- 56.3
- calibration
- 88.3
- speed
- 93.6
- cost
- 63.1
Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.
Run and cost evidence
- Run status
- complete · 1,624 decisions · 0 missing
- Cost
- $0.017 per 1,000 decisions · estimate · documented hosted-model estimate; reference deepinfra:Qwen/Qwen3.5-4B frozen at the 25 Sep cut-off; the snapshot records deprecation on 11 Jun 2026 and replacement by Qwen/Qwen3.5-9B; the frozen snapshot rates remain in use (I-3)
- Median latency
- 0.182 seconds, adjusted · x2 + 0.15 s (assumption, not measured)
- Endpoint condition
- evaluator-owned Lium GPU pod (H100), offline read-only container
Values come from the public v1.5.2 aggregate. Scores and ranks may change in a later release.
Read the full leaderboard, the v1.5.2 release page, and the published method.