Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions bench/npu-leaderboard/27b-mtp-hit-rate-20261105.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-hit-rate-20261105",
"metric": {
"name": "draft hit rate (live loop, k=4)",
"value": 46.69,
"unit": "%"
},
"notes": "338 accepted of 724 drafts over 181 chain iterations; the offer rate is what the all-chains per-depth rows above compose with."
}
29 changes: 29 additions & 0 deletions bench/npu-leaderboard/27b-mtp-live-depth1-20261105.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-live-depth1-20261105",
"metric": {
"name": "draft acceptance, depth 1 (live loop, all chains)",
"value": 75.14,
"unit": "%"
},
"notes": "136/181 chains. 8 prompts x 64 tokens, k=4, tau=0; greedy text byte-identical to plain decode on 8 of 8 prompts, 0 stream mismatches. The window is the union of three npu-hold tickets, not three repeats of one window. Per-depth rates conditional on reaching the depth (what the 2 pp clause compares): 75.14 / 63.24 / 73.26 / 84.13 % live against 75.14 / 62.69 / 73.17 / 83.05 % offline at the same positions -- deltas +0.00 / +0.55 / +0.09 / +1.08 pp, 4 of 4 PASS. The all-chains view recorded here (each depth over all 181 chains) reads +0.00 / +1.10 / +1.66 / +2.21 pp on the same counts, so the two conditionings disagree at depth 4; every rate in this row is the all-chains one."
}
29 changes: 29 additions & 0 deletions bench/npu-leaderboard/27b-mtp-live-depth2-20261105.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-live-depth2-20261105",
"metric": {
"name": "draft acceptance, depth 2 (live loop, all chains)",
"value": 47.51,
"unit": "%"
},
"notes": "86/181 chains; 86 of 136 reached = 63.24 % conditional, against offline 84/134 = 62.69 % (84/181 = 46.41 % all-chains)."
}
29 changes: 29 additions & 0 deletions bench/npu-leaderboard/27b-mtp-live-depth3-20261105.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-live-depth3-20261105",
"metric": {
"name": "draft acceptance, depth 3 (live loop, all chains)",
"value": 34.81,
"unit": "%"
},
"notes": "63/181 chains; 63 of 86 reached = 73.26 % conditional, against offline 60/82 = 73.17 % (60/181 = 33.15 % all-chains)."
}
29 changes: 29 additions & 0 deletions bench/npu-leaderboard/27b-mtp-live-depth4-20261105.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-live-depth4-20261105",
"metric": {
"name": "draft acceptance, depth 4 (live loop, all chains)",
"value": 29.28,
"unit": "%"
},
"notes": "53/181 chains; 53 of 63 reached = 84.13 % conditional, against offline 49/59 = 83.05 % (49/181 = 27.07 % all-chains). This is the depth where the all-chains view reads +2.21 pp and the conditional one +1.08 pp."
}
29 changes: 29 additions & 0 deletions bench/npu-leaderboard/27b-mtp-live-tokens-per-pass-20261105.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-live-tokens-per-pass-20261105",
"metric": {
"name": "tokens per pass (live loop, k=4)",
"value": 2.87,
"unit": "tokens/pass"
},
"notes": "1 + accepted/iterations = 1 + 338/181; hit rate 338/724 = 46.69 %. Pooled over the window's iterations, not the unweighted mean of the 8 per-prompt chains (3.14, the figure docs/npu.md quotes) -- they differ because the prompts with short chains take more iterations: 1.80 to 4.33 tokens/pass per prompt."
}
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
{
"host": "strixhalo",
"model": "Qwen3.8-27B-NPU2",
"route": "npu",
"quant": "Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact",
"settings": {
"device": "accel0",
"model_dir": "bonsai2-27b-pb16i",
"head": "pb16i-exact",
"k": 4,
"tau": 0,
"prompts": 8,
"tokens_per_prompt": 64,
"batch_rows": 16,
"vocab": 248320,
"hidden": "post-final-norm"
},
"instrument": "tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations",
"repeats": 3,
"timestamp": "2026-11-05T16:07:13Z",
"source": "tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713)",
"id": "27b-mtp-offline-tokens-per-pass-20261105",
"metric": {
"name": "tokens per pass (offline protocol, same positions, k=4)",
"value": 2.82,
"unit": "tokens/pass"
},
"notes": "1 + 329/181: the offline protocol restricted to the live loop's own chain positions, which is the pair the 2 pp clause compares. Not the published offline bar, which scores every position and gives 3.19 tokens/pass on this pack (engine#805) -- a different position sample, not a better measurement."
}
14 changes: 14 additions & 0 deletions docs/npu-leaderboard.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,13 @@ One row is one measured run of this engine. A record is only ranked if it names
| Qwen3-Coder-30B-A3B-Instruct | hrx | Q4_K_M | decode aggregate | 87.73 tok/s | parallel=4, requests_in_flight=4, kv_unified=True, n_ctx=8192, per_stream_tok_s=21.94, solo_same_server_tok_s=84.22, engine=38e29a2 + i612-npu-streams (b78868c), llama_cpp=40c4ccb76, model_file=Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf | 5 | wall clock per request + usage.completion_tokens, n_predict=128, temperature 0, greedy, distinct prompts |
| Qwen3-Coder-30B-A3B-Instruct | hrx | Q4_K_M | decode | 84.33 tok/s | parallel=1, requests_in_flight=1, n_ctx=8192, engine=38e29a2 + i612-npu-streams (b78868c), llama_cpp=40c4ccb76, model_file=Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf | 5 | wall clock per request + usage.completion_tokens, n_predict=128, temperature 0, greedy, distinct prompts |
| Qwen3-Coder-30B-A3B-Instruct | hrx | Q4_K_M | decode aggregate | 63.45 tok/s | parallel=2, requests_in_flight=2, kv_unified=True, n_ctx=8192, per_stream_tok_s=31.73, solo_same_server_tok_s=84.33, engine=38e29a2 + i612-npu-streams (b78868c), llama_cpp=40c4ccb76, model_file=Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf | 5 | wall clock per request + usage.completion_tokens, n_predict=128, temperature 0, greedy, distinct prompts |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | draft acceptance, depth 1 (live loop, all chains) | 75.14 % | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | draft acceptance, depth 2 (live loop, all chains) | 47.51 % | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | draft hit rate (live loop, k=4) | 46.69 % | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | draft acceptance, depth 3 (live loop, all chains) | 34.81 % | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | draft acceptance, depth 4 (live loop, all chains) | 29.28 % | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | tokens per pass (live loop, k=4) | 2.87 tokens/pass | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX pb16i (int8 GEMM) + MTP head pb16i-exact | tokens per pass (offline protocol, same positions, k=4) | 2.82 tokens/pass | device=accel0, model_dir=bonsai2-27b-pb16i, head=pb16i-exact, k=4, tau=0, prompts=8, tokens_per_prompt=64, batch_rows=16, vocab=248320, hidden=post-final-norm | 3 | tools/mtp_depth_pool.py over the three in-tree tickets tests/fixtures/mtp_clause55/*.txt; counts summed over the window's 181 chain iterations |
| Qwen3.8-27B-NPU2 | npu | Q4NX (int8 GEMM) | prefill | 58.14 s | device=accel0, addon=npu-dx 1e89468d4, engine=fix/587-gdn-batch on 800cf6f, batch=5 tokens in one step_batch chunk, submits=350, threads=4, pin=0-3, tokens=1 | 1 | wall clock for one request + /proc/<pid>/stat cpu_s + npu-trace submit count; same prompt/params as the 145.7 s sequential record |
| Qwen3.8-27B-NPU2 | npu | Q4NX (int8 GEMM) | decode | 63.1 s/token | device=accel0, addon=npu-dx 1e89468d4, threads=4, pin=0-3, tokens=8 | 1 | wall clock / tokens, 505 s for 8 greedy tokens |
| Qwen3.8-27B-NPU2 | npu | Q4NX (int8 GEMM) | decode | 67.5 s/token | device=accel0, addon=local xrt-free patch, threads=4, tokens=8 | 1 | wall clock / tokens, 540 s for 8 greedy tokens |
Expand All @@ -44,6 +51,13 @@ One row is one measured run of this engine. A record is only ranked if it names
- `coder30b-hrx-parallel4-20261030` — 2026-10-30T21:16:28Z; source: ~/lb/612-hrx-20261030T211252Z (tools/showcase-612-hrx.sh 2 4 8 on an idle strixhalo, under gpu-hold label 'pi i612'); reproduces ~/lb/612-hrx-20261030T064957Z; 1.04x: four streams only recover the single-stream baseline (91.11 / 1.08x at 06:45Z). llama-server reports all four slots decoding in one batch at 24.88 t/s each, so the batching is real; the aggregate is flat because the model is bandwidth-bound. No --parallel 8 row is published: at 8 streams the rate is non-stationary inside a run (llama-server's own tg per slot goes 14.99 15.12 14.34 12.10 7.09 6.78 5.70 5.64 as the answers grow, then 14.17 for a fresh batch, with die temp 61-71 C and iGPU sclk 694-2127 MHz swinging normally), so an 8-stream number is a function of where in that decay it is sampled: 112.89 / 1.34x at 06:45Z, 78.87 / 0.97x and 68.29 / 0.92x later the same day.
- `coder30b-hrx-solo-20261030` — 2026-10-30T21:16:28Z; source: ~/lb/612-hrx-20261030T211252Z (tools/showcase-612-hrx.sh 2 4 8 on an idle strixhalo, under gpu-hold label 'pi i612'); reproduces ~/lb/612-hrx-20261030T064957Z; One request at a time, the baseline the batched rows are read against. Measured as the solo arm of the --parallel 2/4 servers (84.33 / 84.22, ten requests) and 81.39 on the --parallel 8 server; across both runs today the same load gave 74.03-88.34, i.e. +-8 %, so compare ratios, not absolute tok/s.
- `coder30b-hrx-parallel2-20261030` — 2026-10-30T21:16:28Z; source: ~/lb/612-hrx-20261030T211252Z (tools/showcase-612-hrx.sh 2 4 8 on an idle strixhalo, under gpu-hold label 'pi i612'); reproduces ~/lb/612-hrx-20261030T064957Z; 0.75x: two requests in flight are slower in aggregate than one, and it reproduces (62.96 at 06:45Z, 63.45 here, on different clocks). A 2-row decode batch costs 29.0 ms/token per stream against 11.9 ms for one row; with ONEBIT_HRX_DECODE_SPLIT=0 the same server gives 57.59 from a 45 tok/s solo, so the vectorised decode-split path is the suspect -- not settled.
- `27b-mtp-live-depth1-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 136/181 chains. 8 prompts x 64 tokens, k=4, tau=0; greedy text byte-identical to plain decode on 8 of 8 prompts, 0 stream mismatches. The window is the union of three npu-hold tickets, not three repeats of one window. Per-depth rates conditional on reaching the depth (what the 2 pp clause compares): 75.14 / 63.24 / 73.26 / 84.13 % live against 75.14 / 62.69 / 73.17 / 83.05 % offline at the same positions -- deltas +0.00 / +0.55 / +0.09 / +1.08 pp, 4 of 4 PASS. The all-chains view recorded here (each depth over all 181 chains) reads +0.00 / +1.10 / +1.66 / +2.21 pp on the same counts, so the two conditionings disagree at depth 4; every rate in this row is the all-chains one.
- `27b-mtp-live-depth2-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 86/181 chains; 86 of 136 reached = 63.24 % conditional, against offline 84/134 = 62.69 % (84/181 = 46.41 % all-chains).
- `27b-mtp-hit-rate-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 338 accepted of 724 drafts over 181 chain iterations; the offer rate is what the all-chains per-depth rows above compose with.
- `27b-mtp-live-depth3-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 63/181 chains; 63 of 86 reached = 73.26 % conditional, against offline 60/82 = 73.17 % (60/181 = 33.15 % all-chains).
- `27b-mtp-live-depth4-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 53/181 chains; 53 of 63 reached = 84.13 % conditional, against offline 49/59 = 83.05 % (49/181 = 27.07 % all-chains). This is the depth where the all-chains view reads +2.21 pp and the conditional one +1.08 pp.
- `27b-mtp-live-tokens-per-pass-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 1 + accepted/iterations = 1 + 338/181; hit rate 338/724 = 46.69 %. Pooled over the window's iterations, not the unweighted mean of the 8 per-prompt chains (3.14, the figure docs/npu.md quotes) -- they differ because the prompts with short chains take more iterations: 1.80 to 4.33 tokens/pass per prompt.
- `27b-mtp-offline-tokens-per-pass-20261105` — 2026-11-05T16:07:13Z; source: tests/fixtures/mtp_clause55/{p0,p1-4,p5-7}.txt, verbatim extracts of npu-hold tickets clause55 p0|p1-4|p5-7 (20261105-115131|115551|120713); 1 + 329/181: the offline protocol restricted to the live loop's own chain positions, which is the pair the 2 pp clause compares. Not the published offline bar, which scores every position and gives 3.19 tokens/pass on this pack (engine#805) -- a different position sample, not a better measurement.
- `27b-prefill-batched-20261027` — 2026-10-27T21:33:22Z; source: ~/lb/587-gbnos.sh run log 587-gbnos-server-20261027T213012Z.log; prompt 'The capital of France is' -> ' Paris'; sequential baseline for the same request was 2298 submits / 145.7 s; device wait is 26 ms per submit, so cost tracks submit count
- `27b-npudx-20261027` — 2026-10-27T14:40:00Z; source: ~/lb/587-npudx-smoke.sh run log on strixhalo; prompt 'The capital of France is' -> ' Paris.\nThe capital of Germany is'; upstream add-on, no local patch
- `27b-localaddon-20261027` — 2026-10-27T14:20:00Z; source: ~/lb/587-noxrt-smoke-20261027T101012Z.log; same text as the npu-dx row; kept because it is the pair that established the add-on does not move decode
Expand Down
Loading
Loading