Skip to content

ggml-hrx: route Q4_K/Q5_K/IQ4_XS prompt matmuls to the q8_1 x4 kernel (pp512 99 -> 341 on Qwen3.8-27B) - #55

Merged
bong-water-water-bong merged 2 commits into
1bit/hrx-vulkan-patchedfrom
1bit/hrx-q8-prefill-policy
Oct 1, 2026
Merged

bong-water-water-bong merged 2 commits into
1bit/hrx-vulkan-patchedfrom
1bit/hrx-q8-prefill-policy

Commits

  1. Commits on Oct 1, 2026