Skip to content

[None][feat] Call LLM(batched_logits_processor=...) on the PyTorch backend - #21044

Open
lminer wants to merge 8 commits into
NVIDIA:mainfrom
lminer:feat/batched-logits-processor-pytorch
Open

lminer wants to merge 8 commits into
NVIDIA:mainfrom
lminer:feat/batched-logits-processor-pytorch

[None][chore] Keep BatchedLogitsProcessor's stream_ptr an int

2385d88
Select commit
Loading
Failed to load commit list.