npu forward: the batched int8 head chunks rows by the kernel's capacity, so a 64-row verify pass is 9.9x faster - #1364

npu forward: the batched int8 head chunks rows by the kernel's capacity, so a 64-row verify pass is 9.9x faster#1364

bong-water-water-bong merged 2 commits into

main1bit-MONSTER/engine:mainfrom

1bit/1341-row-chunks1bit-MONSTER/engine:1bit/1341-row-chunksCopy head branch name to clipboard