forward-serve: read eos_token_id as a list, so a Llama container stops at <|eot_id|> - #1052

forward-serve: read eos_token_id as a list, so a Llama container stops at <|eot_id|>#1052

bong-water-water-bong merged 2 commits into

main1bit-MONSTER/engine:mainfrom

1bit/1044-eos-list1bit-MONSTER/engine:1bit/1044-eos-listCopy head branch name to clipboard