fix: route Granite models to TokenizersBackend to preserve tokenizer.json pre-tokenizer - #45813

fix: route Granite models to TokenizersBackend to preserve tokenizer.json pre-tokenizer#45813

itazap merged 4 commits into

huggingface:mainhuggingface/transformers:mainfrom

kndtran:fix/granite-tokenizer-pretokenizerkndtran/transformers:fix/granite-tokenizer-pretokenizerCopy head branch name to clipboard