You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Disable thinking if reasoning_effort is none. #1028
To maintain the open AI compatibility of your API, would it be possible to disable the reasoning of the LLM if reasoning_effort: "none" is specified in the request?
I know the standard way to disable the thinking for models such as Gemma 4 and Qwen 3 would be { ..., chat_template_kwargs: {"enable_thinking": false} }, but I don't want to have to write VLLM/LLAMA specefic parameters in OpenAI request.
Reasonable, needs an OpenAI reasoning_effort to backend-specific mapping like the existing Ollama think mapping. Model-runner is being deprecated in favor of llmman, please open this issue and any fix PR against docker/llmman instead.
Activity
ericcurtin commentedon Sep 26, 2026
Reasonable, needs an OpenAI reasoning_effort to backend-specific mapping like the existing Ollama think mapping. Model-runner is being deprecated in favor of llmman, please open this issue and any fix PR against docker/llmman instead.