You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
hyperloom custom workload: a result names its model by file name only, not by the fingerprint its own quality gate is keyed on #993
No path, no hash, and the (HRX0, gfx1151) part is a literal in the source, not a measurement. Across every result
artifact this lane produced on this box: 140 artifacts carrying a bench_summary (150 result files scanned, from 70
distinct measurement directories), 0 with any model field.
Meanwhile the gate is keyed on the file's fingerprint: ref.json carries "model": "0bc73cb2357258a977f33f910a7d2b02c3c3ac7db98e4dcac6b58a8618b43827" and main() drops the stored references when the
measured file's sha256_head no longer matches it (if ref.get("model") not in (None, fingerprint) → ref = {}). So the
report says whether the references still apply, in the negative direction only (a WARNING line in a log), and the
positive claim ("this score and this KLD verdict belong to file X") exists nowhere in the artifact.
That is not hypothetical on this box: the 31 Oct restore took the weights and left ~/lb/hl-gate/.../{kld-base.kld, texts.json,ref.json} in place, so the weights were re-downloaded while the references survived — the same file name here
can legitimately be a different file, and every number of record (44.69 baseline, 50.87 best, the 18.8k long-context
pair) is tied to its weights by prose in a state file rather than by the artifact.
Wanted: every result names the model file it measured — resolved path plus the sha256_head fingerprint the gate uses, so
a result and a reference can be matched by hash instead of by file name.
Adjacent, measured while checking this, not fixed here:bench_summary.placement is null in 140 of 140 artifacts
— the placement counts only surface at the library's INFO level and 1bit serve has no -lv passthrough — so in practice
the artifact never states the HRX placement it was measured with, and a null cannot be told from "not captured".
Out of scope here: model_id itself is Hyperloom's own display string and is consumed by the report, so it is left as is.
Correction to this issue's adjacent note, measured 2026-11-04 13:4x: the cause it names is wrong. 1bit servedoes have the -lv passthrough — it is --placement-report (and --strict-device), which pass -lv 4 at app/serve.cpp:1059 (app/hrx_strict.h:60). The adapter simply never passed either, which is why GGML_HRX_REPORT=2 never reached serve.log. Filed as #1008 and fixed in #1009; the counts are now 147/147 artifacts with placement: null and 0/71 serve.logs carrying the line.
Activity
bong-water-water-bong commentedon Nov 4, 2026
Correction to this issue's adjacent note, measured 2026-11-04 13:4x: the cause it names is wrong.
1bit servedoes have the-lvpassthrough — it is--placement-report(and--strict-device), which pass-lv 4atapp/serve.cpp:1059(app/hrx_strict.h:60). The adapter simply never passed either, which is whyGGML_HRX_REPORT=2never reached serve.log. Filed as #1008 and fixed in #1009; the counts are now 147/147 artifacts withplacement: nulland 0/71 serve.logs carrying the line.hyperloom custom: the result names the model file it measured, by the…
hyperloom custom: the result names the model file it measured, by the…
hyperloom custom: the result records whether the served decode drafted (
bench: name the workload script that computed the number (bench_summa…