Repository navigation
Pin llama.cpp 6617e78: Q3_K/IQ3_S decode on HRX, no spinning wait (27B 97% of Vulkan) - #236
Conversation
…B 97% of Vulkan, 74 C) llama.cpp #43: Q3_K and IQ3_S in the K-quant decode kernels (Qwen3.8-27B UD-Q4_K_XL 11.60 -> 12.15 tok/s, Vulkan 12.48). llama.cpp #44: long stream waits sleep instead of spinning a CPU core in ROCr's signal wait (27B decode 71-76 C / ~125 W instead of 83-93 C / 133-137 W, -0.4%). docs/hrx.md updated. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Docs7 for 1bit-monster/engine
Commit |
PR Reviewer Guide 🔍Here are some key observations to aid the review process:
|
Pins
third_party/llama.cppto6617e78, which brings in two fork PRs.llama.cpp #43: Q3_K and IQ3_S in the K-quant decode kernels.
test-backend-ops -o MUL_MAT -b HRX0passes.llama.cpp #44: HRX decode no longer spins a CPU core.
Also in this PR:
registry/architectures.jsonis regenerated;--check-pinspasses.docs/hrx.mdis updated.🤖 Generated with Claude Code