hrx: one-token MUL_MAT_ID as a GEMV over the selected experts (ZAYA1-8B decode +34%) - #32

hrx: one-token MUL_MAT_ID as a GEMV over the selected experts (ZAYA1-8B decode +34%)#32

bong-water-water-bong merged 1 commit into

1bit/hrx-vulkan-patched1bit-MONSTER/llama.cpp:1bit/hrx-vulkan-patchedfrom

1bit/hrx-moe-decode-gemv1bit-MONSTER/llama.cpp:1bit/hrx-moe-decode-gemvCopy head branch name to clipboard