[None][feat] Add opt-in cascade attention for wide beam search on KVCM V2 - #21738

[None][feat] Add opt-in cascade attention for wide beam search on KVCM V2#21738

hchings wants to merge 11 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

hchings:user/hchings/beam-shared-prefix-fmhahchings/TensorRT-LLM:user/hchings/beam-shared-prefix-fmhaCopy head branch name to clipboard