Skip to content
Navigation Menu
Sign in
Products
Platform
GitHub
Repository hosting, code review, and collaboration
Copilot
AI coding agent for tasks, projects, and automated work
Build & Ship
Actions
CI/CD and automation
Code Quality
Quality analysis, fixes, and enforcement
Codespaces
Cloud development environments
Secure
Code Security
Vulnerability detection and remediation
Secret Protection
Secret scanning and leak prevention
All Features
Developers
Learn
Documentation
Training
Certifications
Build
Build with Copilot
Customize Copilot
Integrations
Explore
Trending repos
GitHub Sponsors
Developer articles
Changelog
Changelog
Your source for the latest features, improvements, and fixes across GitHub products, all in one place.
Businesses
By Stage
Enterprises
Team
Startups
Nonprofits
By Industry
Healthcare
Financial services
Manufacturing
Government
See all industries
Evaluate GitHub
Why GitHub
Customer Stories
Business insights
Trust Center
Add-ons
GitHub Advanced Security
Enterprise-grade code security
Copilot for business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Resources
Learn & Connect
Documentation
Resource center
Blog
Events & webinars
Community Forum
Customer Stories
Integrations
Support
Customer support
Training
GitHub Status
Company
About
Partners
Changelog
GitHub Universe
GitHub Universe
The event for developers, by developers — talks, workshops, and what’s next for GitHub.
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
NVIDIA
TensorRT-LLM
Repository navigation
Code
Issues
742
(742)
Pull requests
1.3k
(1.3k)
Discussions
Actions
Projects
Security and quality
Insights
More
items
[None][perf] DSv4 follow-up: disagg routing improvements
- #15625
#15625
Merged
lancelly
merged 29 commits into
NVIDIA:
main
NVIDIA/TensorRT-LLM:main
from
lfr-
0531:
user/
fanrongl/
dsv4-
a7728aa-
pr2-
router-
20260625
lfr-0531/TensorRT-LLM:user/fanrongl/dsv4-a7728aa-pr2-router-20260625
Copy head branch name to clipboard
Jul 2, 2026
Conversation
Commits
29
(29)
Checks
Files changed
Merged
[None][perf] DSv4 follow-up: disagg routing improvements
#15625
lancelly
merged 29 commits into
NVIDIA:
main
NVIDIA/TensorRT-LLM:main
from
lfr-
0531:
user/
fanrongl/
dsv4-
a7728aa-
pr2-
router-
20260625
lfr-0531/TensorRT-LLM:user/fanrongl/dsv4-a7728aa-pr2-router-20260625
Copy head branch name to clipboard
Commits
Commits on Jun 30, 2026
[None][feat] adp_router: salt-aware probe_prefix_match_length on v1/v2 KV cache backends (#14435)
Show description for cb9375c
lancelly
authored and
Shixiaowei02
committed
cb9375c
View commit details
Copy full SHA for cb9375c
Browse repository at this point
[TRTLLM-12941][fix] Selective retry for transient TCP races in disagg HTTP client (#14562)
Show description for f7e3ab3
Shixiaowei02
committed
f7e3ab3
View commit details
Copy full SHA for f7e3ab3
Browse repository at this point
[None][feature] Gen-first disagg with transceiver v2 (#14407)
Show description for 0a5ec7a
Shixiaowei02
committed
0a5ec7a
View commit details
Copy full SHA for 0a5ec7a
Browse repository at this point
[None][feat] Support tool-calling in KvCacheAwareRouter for disagg serving (feat/deepseek_v4) (#14611)
Show description for d4bb514
lishicheng1996-nv
authored and
Shixiaowei02
committed
d4bb514
View commit details
Copy full SHA for d4bb514
Browse repository at this point
[None][perf] use native C++ BlockKeyHasher in disagg router to improve TTFT (#14767)
Show description for fd1085a
zheyuf
authored and
Shixiaowei02
committed
fd1085a
View commit details
Copy full SHA for fd1085a
Browse repository at this point
[None][fix] adp router: gate in-transfer load accounting behind a config flag (#14860)
Show description for 6b831c1
lancelly
authored and
Shixiaowei02
committed
6b831c1
View commit details
Copy full SHA for 6b831c1
Browse repository at this point
[None][fix] Optimize cache-aware router backfill and validate worker handshake (#14950)
Show description for f37f24e
Shixiaowei02
committed
f37f24e
View commit details
Copy full SHA for f37f24e
Browse repository at this point
[None][fix] Relax tokens_per_block mismatch check in dis-agg router (#15005)
Show description for 22689ce
Shixiaowei02
committed
22689ce
View commit details
Copy full SHA for 22689ce
Browse repository at this point
[None][perf] ConversationRouter: skip block-hash compute on sticky conversation_id routing (#14957)
Show description for 9195548
lishicheng1996-nv
authored and
Shixiaowei02
committed
9195548
View commit details
Copy full SHA for 9195548
Browse repository at this point
[None][feat] Introduce tokenizer cache and absolute block score (#15040)
Show description for 460418e
Shixiaowei02
committed
460418e
View commit details
Copy full SHA for 460418e
Browse repository at this point
[None][perf] disagg gen: prepend new generation-only requests to active list (#14867)
Show description for 5d1176f
lancelly
authored and
Shixiaowei02
committed
5d1176f
View commit details
Copy full SHA for 5d1176f
Browse repository at this point
[None][feat] Add ConversationAwareADPRouter: explicit conversation->rank affinity for attention DP (#14983)
Show description for 165fc53
lancelly
authored and
Shixiaowei02
committed
165fc53
View commit details
Copy full SHA for 165fc53
Browse repository at this point
[None][feat] Dis-agg content-derived conversation affinity (#15074)
Show description for 7794a36
Shixiaowei02
committed
7794a36
View commit details
Copy full SHA for 7794a36
Browse repository at this point
[None][perf] disagg: single-pass request serialization on orchestrator forward path (#15041)
Show description for eb15feb
lancelly
authored and
Shixiaowei02
committed
eb15feb
View commit details
Copy full SHA for eb15feb
Browse repository at this point
[None][perf] disagg: skip per-chunk JSON parse on streaming usage rewrite (#15042)
Show description for c3e0d24
lancelly
authored and
Shixiaowei02
committed
c3e0d24
View commit details
Copy full SHA for c3e0d24
Browse repository at this point
[None][perf] reduce rank-0 GIL contention in disaggregated generation (#15133)
Show description for dd95b12
lancelly
authored and
Shixiaowei02
committed
dd95b12
View commit details
Copy full SHA for dd95b12
Browse repository at this point
[None][perf] avoid full input_token_ids copy in ADP router token count (#15199)
Show description for c9e7642
lancelly
authored and
Shixiaowei02
committed
c9e7642
View commit details
Copy full SHA for c9e7642
Browse repository at this point
[None][fix] py_executor: lift conditional tp_allgather sites out of per-rank-divergent gates (#14560)
Show description for 983fe50
lancelly
authored and
Shixiaowei02
committed
983fe50
View commit details
Copy full SHA for 983fe50
Browse repository at this point
[None][fix] disagg: echo prompt_token_ids on chat context-only response (#14844)
Show description for d667c31
lancelly
authored and
Shixiaowei02
committed
d667c31
View commit details
Copy full SHA for d667c31
Browse repository at this point
[None][fix] disagg: use ctx retry id for gen request (#15309)
Show description for 299e682
liji-nv
authored and
Shixiaowei02
committed
299e682
View commit details
Copy full SHA for 299e682
Browse repository at this point
[None][perf] disagg: optionally drop message history from generation request (#15366)
Show description for 7be4388
lancelly
authored and
Shixiaowei02
committed
7be4388
View commit details
Copy full SHA for 7be4388
Browse repository at this point
[None][fix] keep disagg routing PR self-contained
Show description for db2ac6c
lfr-0531
authored and
Shixiaowei02
committed
db2ac6c
View commit details
Copy full SHA for db2ac6c
Browse repository at this point
[None][feat] add conversation params routing support
Show description for 55c9e75
lfr-0531
authored and
Shixiaowei02
committed
55c9e75
View commit details
Copy full SHA for 55c9e75
Browse repository at this point
[None][fix] pass cache salt to ADP prefix probe
Show description for fddf2ca
lfr-0531
authored and
Shixiaowei02
committed
fddf2ca
View commit details
Copy full SHA for fddf2ca
Browse repository at this point
[None][fix] kv_cache_manager_v2: restore probe_prefix_match_length on V2 backend
Show description for 2d85deb
lancelly
authored and
Shixiaowei02
committed
2d85deb
View commit details
Copy full SHA for 2d85deb
Browse repository at this point
[None][fix] disagg: remove dead usage-rewrite machinery folded into #15042
Show description for 23c372b
lancelly
authored and
Shixiaowei02
committed
23c372b
View commit details
Copy full SHA for 23c372b
Browse repository at this point
[None][fix] disagg: MTP AuxBuffer max_draft_len + conditional_v2 perf-metrics test
Show description for 75c3eda
Shixiaowei02
committed
75c3eda
View commit details
Copy full SHA for 75c3eda
Browse repository at this point
Commits on Jul 1, 2026
[None][fix] api_stability: track conversation_params on serve request models
Show description for d017cde
lancelly
committed
d017cde
View commit details
Copy full SHA for d017cde
Browse repository at this point
Merge branch 'main' into user/fanrongl/dsv4-a7728aa-pr2-router-20260625
Show description for 7171b81
lancelly
committed
7171b81
View commit details
Copy full SHA for 7171b81
Browse repository at this point
You can’t perform that action at this time.
