IQ4_NL: 4-bit non-linear quants with blocks of 32 - #5590

IQ4_NL: 4-bit non-linear quants with blocks of 32#5590

ikawrakow merged 6 commits into

masterggml-org/llama.cpp:masterfrom

ik/iq4_nl_no_superblockggml-org/llama.cpp:ik/iq4_nl_no_superblockCopy head branch name to clipboard