Repository navigation
Pin llama.cpp 45c1770: HRX fuses ZAYA's residual scale - #230
Conversation
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Docs7 for 1bit-monster/engine
Commit |
PR Reviewer Guide 🔍(Review updated until commit 737e653)Here are some key observations to aid the review process:
|
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Persistent review updated to latest commit 8f752cf |
|
Persistent review updated to latest commit 737e653 |
Moves
third_party/llama.cppb408831 -> 45c1770 (fork #35).ZAYA scales both residual branches twice per layer,
(x + bx)·sx + (r + br)·sr. On HRX that was up to nine tiny ADD / MUL dispatches per layer; each side is now one dispatch. Measured on strixhalo (gfx1151), ZAYA1-8B Q4_K_M on HRX0:Part of RFC #213 gate 1.
docs/hrx.mdgets a line on it. The next ZAYA step, skipping no-op CONTs (+2.4%, fork #36), will come as its own pin.🤖 Generated with Claude Code