Decision 4B v1.1 (FlyMyJev, Qwen3.5-4B + LoRA)
Unclassified · Author not recorded · Openness: unknown
v1.5 roster addendum A1
not recorded
JevBench v1.5.2 score
70.386
Option A: rank #10 of 99 ranked systems.
The three option scores and ranks are published independently; the headline is Option A.
| Option | Score | Rank |
|---|---|---|
| A · headline | 70.386 | #10 of 99 |
| B | 66.086 | #12 of 99 |
| C | 55.144 | #14 of 99 |
Published axes
- intelligence
- 53.1
- calibration
- 87.3
- speed
- 93.5
- cost
- 63.1
Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.
Run and cost evidence
- Run status
- complete · 1,624 decisions · 0 missing
- Cost
- $0.017 per 1,000 decisions · estimate · documented hosted-model estimate; reference deepinfra:Qwen/Qwen3.5-4B frozen at the 25 Sep cut-off; the snapshot records deprecation on 11 Jun 2026 and replacement by Qwen/Qwen3.5-9B; the frozen snapshot rates remain in use (I-3)
- Median latency
- 0.183 seconds, adjusted · x2 + 0.15 s (assumption, not measured)
- Endpoint condition
- evaluator-owned Lium GPU pod (H100), offline read-only container
Values come from the public v1.5.2 aggregate. Scores and ranks may change in a later release.
Read the full leaderboard, the v1.5.2 release page, and the published method.