Qwen3-8B · development
EAGLE-3 k=3 reference
Passed every gate.
SpecScore1.282geometric mean of the three speedups
solo1.36×
one lane; passes 1.31, 1.36, 1.36
team1.33×
team lanes busy; passes 1.34, 1.30, 1.33
busy1.17×
KV cache nearly full; passes 1.17, 1.18, 1.15
Lossless gate
what each check is →| Check | Measured | Limit | |
|---|---|---|---|
| device memory | 162.7 GiB | ≤ 165.2 GiB | pass |
| fixed texts' log-probabilities | 7.4e-07 | ≤ 0.002 | pass |
| sampled replies' likelihood | +0.0267 ± 0.0950 | within ±0.05 at 95% | pass |
| share of first choices | – | within ±None at 95% | n/a |
| greedy agreement | 1.000 | none on this task | n/a |
| reply lengths | – | 1 ± 0.05 at 95% | pass |
Speculation
| Workload | Tokens / verify step | Speedup |
|---|---|---|
| solo | 1.77 | 1.36 |
| team | 1.88 | 1.33 |
| busy | 1.87 | 1.17 |
Speculator: RedHatAI/Qwen3-8B-speculator.eagle3@08610ff
Engine: a directory of its workspace
Everything the judge recorded
{
"ratios": {
"solo": {
"passes": [
1.3056037228619444,
1.362950208400478,
1.3587346244486131
],
"ratio": 1.3587346244486131
},
"team": {
"passes": [
1.3353658868365827,
1.3040156071469573,
1.325593064506196
],
"ratio": 1.325593064506196
},
"busy": {
"passes": [
1.17017695379369,
1.1844650551391556,
1.1460675357941217
],
"ratio": 1.17017695379369
}
},
"specscore": 1.282130216371606,
"greedy_agreement": 1.0,
"likelihood": {
"gap": 0.026732992624794782,
"se": 0.04846209296690282,
"candidate": -0.6574152840470416,
"stock": -0.6841482766718364
},
"fidelity": 7.426521380254449e-07,
"lengths": {
"solo": {
"ratio": 0.9275707084469272,
"low": 0.6392609187883227,
"high": 1.2158804981055318
},
"team": {
"ratio": 0.9901981221133276,
"low": 0.8451997700247822,
"high": 1.135196474201873
},
"busy": {
"ratio": 0.9584691840581923,
"low": 0.8567397874254123,
"high": 1.0601985806909722
}
},
"memory": {
"ok": true,
"peak_mib": 166560.0,
"allowed_mib": 169119.1
},
"acceptance": {
"solo": 1.7737053279835775,
"team": 1.882058539987283,
"busy": 1.8653558759318247
},
"limits": {
"greedy_agreement_floor": null,
"likelihood_bound": 0.05,
"fidelity_ceiling": 0.002,
"length_margin": 0.05,
"memory_slack_mib": 4096
},
"reason": null,
"score": 1.282130216371606
}