Laya multilingual
system-one-open · by Convai Innovations · Code and weights marked open
Base model: mmBERT-basesourcev1.5 roster addendum A4
apache-2.0, not gated
JevBench v1.5.4 score
0.019
Option A: rank #86 of 106 ranked systems.
The three option scores and ranks are published independently; the headline is Option A.
| Option | Score | Rank |
|---|---|---|
| A · headline | 0.019 | #86 of 106 |
| B | 0.012 | #86 of 106 |
| C | 0.013 | #86 of 106 |
Published axes
- intelligence
- 2.4
- calibration
- 43.6
- speed
- 73.7
- cost
- 82.2
Bands use the published 0–100 axis values; the marked reference is Jev 1.13.0 when that axis is available.
Run and cost evidence
- Run status
- complete · 1,624 decisions · 0 missing
- Cost
- $0.0039 per 1,000 decisions · estimate · ESTIMATE: documented hosted-model estimate; no exact base-model floor applies. $0.01/M input, $0/M output; same-class hosted-encoder estimate; no exact-base market floor.
- Median latency
- 1.036 seconds, adjusted · x2 + 0.15 s (assumption, not measured)
- Endpoint condition
- evaluator-owned CPU, Sandy (AMD Ryzen 5 3600), 4 of 12 threads, nice -n 5, shared host, offline (HF_HUB_OFFLINE=1)
Model and serving disclosure
convaiinnovations/laya @ 1c5edc17a7acd8701df6fc341c0d179f1c62c982, multilingual/; mmBERT-base 322M, max_len 1024. Distinct from the published English root checkpoint. Fresh run from item 1 on 29 Sep; interrupted earlier runs were not stitched. In-process, offline, shared AMD Ryzen 5 3600 CPU, four threads. Measured latency includes shared-host conditions; it is not a controlled GPU comparison. The release owner independently adopted mmBERT as unlisted in the frozen pricing snapshots; the labelled same-class encoder estimate has zero cost delta against BAAI/bge-m3.
Values come from the public v1.5.4 aggregate. Scores and ranks may change in a later release.
Read the full leaderboard, the v1.5.4 release page, and the published method.