JevBench v1.5.2 · individual system

Decision 4B v1.1 (FlyMyJev, Qwen3.5-4B + LoRA)

Unclassified · Author not recorded · Openness: unknown

v1.5 roster addendum A1

not recorded

JevBench v1.5.2 score

70.386

Option A: rank #10 of 99 ranked systems.

The three option scores and ranks are published independently; the headline is Option A.

Published JevBench option scores and ranks
OptionScoreRank
A · headline70.386#10 of 99
B66.086#12 of 99
C55.144#14 of 99

Published axes

intelligence
53.1
calibration
87.3
speed
93.5
cost
63.1

Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.

Run and cost evidence

Run status
complete · 1,624 decisions · 0 missing
Cost
$0.017 per 1,000 decisions · estimate · documented hosted-model estimate; reference deepinfra:Qwen/Qwen3.5-4B frozen at the 25 Sep cut-off; the snapshot records deprecation on 11 Jun 2026 and replacement by Qwen/Qwen3.5-9B; the frozen snapshot rates remain in use (I-3)
Median latency
0.183 seconds, adjusted · x2 + 0.15 s (assumption, not measured)
Endpoint condition
evaluator-owned Lium GPU pod (H100), offline read-only container

Values come from the public v1.5.2 aggregate. Scores and ranks may change in a later release.

Read the full leaderboard, the v1.5.2 release page, and the published method.