Skip to content

forward-serve: read eos_token_id as a list, so a Llama container stops at <|eot_id|> - #1052

Merged
bong-water-water-bong merged 2 commits into
mainfrom
1bit/1044-eos-list
Nov 5, 2026
Merged

forward-serve: read eos_token_id as a list, so a Llama container stops at <|eot_id|>#1052
bong-water-water-bong merged 2 commits into
mainfrom
1bit/1044-eos-list

Commits

  1. Commits on Nov 5, 2026