JevBench v1.5.2 · individual system

AutoJev-27B (denis-pplx, Qwen3.8-27B)

Unclassified · Author not recorded · Openness: unknown

v1.5 roster addendum A1

not recorded

JevBench v1.5.2 score

19.541

Option A: rank #50 of 99 ranked systems.

The three option scores and ranks are published independently; the headline is Option A.

Published JevBench option scores and ranks
OptionScoreRank
A · headline19.541#50 of 99
B20.448#47 of 99
C19.541#45 of 99

Published axes

intelligence
72.8
calibration
87.7
speed
87.6
cost
29.4

Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.

Run and cost evidence

Run status
complete · 1,624 decisions · 0 missing
Cost
$0.226 per 1,000 decisions · estimate · documented hosted-model estimate
Median latency
0.352 seconds, adjusted · x2 + 0.15 s (assumption, not measured)
Endpoint condition
evaluator-owned Lium GPU pod (H100), offline read-only container

Values come from the public v1.5.2 aggregate. Scores and ranks may change in a later release.

Read the full leaderboard, the v1.5.2 release page, and the published method.