Repository navigation

[TRTLLM-909][feat] Overlap context chunks in pipeline parallel mode - #9308

Merged

Funatiq merged 7 commits into

NVIDIA:mainfrom

Funatiq:dev/feat/overlap_ctx_chunks

Nov 25, 2025

Merged

[TRTLLM-909][feat] Overlap context chunks in pipeline parallel mode#9308
Funatiq merged 7 commits into
NVIDIA:mainfrom
Funatiq:dev/feat/overlap_ctx_chunks

Commits on Nov 24, 2025
- [feat] Overlap context chunks in pipeline parallel mode
  Funatiq
  committed
  31d3dbc
- [fix] Fix max_num_sequences logging in _util.py
  Funatiq
  committed
  28527ce
- [feat] Overlap context chunks in pipeline parallel mode
  Funatiq
  committed
  e038bd7
- [chore] Improve documentation for inflight request IDs.
  Funatiq
  committed
  1363db5
- [feat] Enhance LLM stats tests with chunked prefill support
  Funatiq
  committed
  f11d572
- [test] Add LLM stats tests for pipeline parallel mode
  Funatiq
  committed
  0adb350
- [test] Update LLM stats tests for async behavior
  Funatiq
  committed
  ef031d4