Skip to content

[https://nvbugs/5398180][feat] Improve Llama4 performance for small max_seqlen cases - #6306

Merged
nv-yilinf merged 10 commits into
NVIDIA:mainfrom
nv-yilinf:optimize-chunked-attention-for-small-max-seqlen
Aug 9, 2025
Merged

[https://nvbugs/5398180][feat] Improve Llama4 performance for small max_seqlen cases#6306
nv-yilinf merged 10 commits into
NVIDIA:mainfrom
nv-yilinf:optimize-chunked-attention-for-small-max-seqlen

fix failed UT

d41e955
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs