Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
NVIDIA
TensorRT-LLM
Repository navigation
Code
Issues
749
(749)
Pull requests
1.3k
(1.3k)
Discussions
Actions
Projects
Security and quality
Insights
More
items
[None][feat] Add Gemma4 variable-window attention
- #18912
#18912
Merged
achartier
merged 17 commits into
NVIDIA:
main
NVIDIA/TensorRT-LLM:main
from
achartier:
gemma4-
sliding-
window
achartier/TensorRT-LLM:gemma4-sliding-window
Copy head branch name to clipboard
Nov 7, 2026
Conversation
Commits
17
(17)
Checks
Files changed
Merged
[None][feat] Add Gemma4 variable-window attention
#18912
achartier
merged 17 commits into
NVIDIA:
main
NVIDIA/TensorRT-LLM:main
from
achartier:
gemma4-
sliding-
window
achartier/TensorRT-LLM:gemma4-sliding-window
Copy head branch name to clipboard
Commits
Commits on Nov 6, 2026
feat: add Gemma4 variable-window attention
Show description for 31b9059
achartier
committed
31b9059
View commit details
Copy full SHA for 31b9059
Browse repository at this point
docs: clarify FMHA support probe length
Show description for 23c4dbf
achartier
committed
23c4dbf
View commit details
Copy full SHA for 23c4dbf
Browse repository at this point
refactor: clarify XQA mask selection
Show description for 7430e82
achartier
committed
7430e82
View commit details
Copy full SHA for 7430e82
Browse repository at this point
fix: clarify variable-window mask handling
Show description for 13de7a6
achartier
committed
13de7a6
View commit details
Copy full SHA for 13de7a6
Browse repository at this point
fix: harden variable-window dispatch
Show description for f6d825c
achartier
committed
f6d825c
View commit details
Copy full SHA for f6d825c
Browse repository at this point
fix: gate variable-window attention support
Show description for 01f3252
achartier
committed
01f3252
View commit details
Copy full SHA for 01f3252
Browse repository at this point
fix: constrain variable-window capability
Show description for 748f6f0
achartier
committed
748f6f0
View commit details
Copy full SHA for 748f6f0
Browse repository at this point
fix: propagate variable-window attention bounds
Show description for c2cab98
achartier
committed
c2cab98
View commit details
Copy full SHA for c2cab98
Browse repository at this point
test: cover unpaired variable-window bounds
Show description for f464012
achartier
committed
f464012
View commit details
Copy full SHA for f464012
Browse repository at this point
fix: preserve bidirectional window reach
Show description for c4a7ef6
achartier
committed
c4a7ef6
View commit details
Copy full SHA for c4a7ef6
Browse repository at this point
[None][fix] Forward separate V token stride to context FMHA
Show description for 1efb6d6
achartier
committed
1efb6d6
View commit details
Copy full SHA for 1efb6d6
Browse repository at this point
[None][fix] Harden Gemma4 variable-window dispatch and validation
Show description for 771a37e
achartier
committed
771a37e
View commit details
Copy full SHA for 771a37e
Browse repository at this point
[None][fix] Address Gemma4 attention review feedback
Show description for 71947e9
achartier
committed
71947e9
View commit details
Copy full SHA for 71947e9
Browse repository at this point
[None][test] Complete Gemma4 attention metadata stub
Show description for 497d4d7
achartier
committed
497d4d7
View commit details
Copy full SHA for 497d4d7
Browse repository at this point
[None][test] Complete FMHA fallback argument stub
Show description for b72cc5a
achartier
committed
b72cc5a
View commit details
Copy full SHA for b72cc5a
Browse repository at this point
[None][fix] Address variable-window review feedback
Show description for bc73ce8
achartier
committed
bc73ce8
View commit details
Copy full SHA for bc73ce8
Browse repository at this point
[None][fix] Port variable-window attention to phased FMHA
Show description for 3e76290
achartier
committed
3e76290
View commit details
Copy full SHA for 3e76290
Browse repository at this point
You can’t perform that action at this time.
