Skip to content

fix(aws): Update DeepSeek V3.x tool choice support on ChatBedrockConverse - #1261

Open
Michael Chin (michaelnchin) wants to merge 1 commit into
langchain-ai:mainfrom
michaelnchin:fix/deepseek-v3-tool-choice
Open

fix(aws): Update DeepSeek V3.x tool choice support on ChatBedrockConverse#1261
Michael Chin (michaelnchin) wants to merge 1 commit into
langchain-ai:mainfrom
michaelnchin:fix/deepseek-v3-tool-choice

Conversation

@michaelnchin

Copy link
Copy Markdown
Collaborator

Fixes #1259

#688, merged in Oct. 2025, restricted DeepSeek V3 models to any ToolChoice mode (based on Bedrock V3.1's tested behavior and upstream V3.2-Exp's docs). However, since then, V3.1's tool choice behavior has changed, as well as that of the stable V3.2 version Bedrock added in Dec. 2025.

Manually ran tool_choice value tests against Converse API to confirm the current situation:

  • With thinking disabled (model default), both DeepSeek V3.1 and V3.2 behave the same:
    • Both auto and any mode now work unconditionally
    • Specific tool mode, while still accepted by Converse API, is not obeyed by either model.
  • With thinking enabled (via {"reasoning_effort": "high"}):
    • any doesn't produce tool calls on either V3.1 or V3.2
    • auto doesn't work on V3.1, but does on V3.2 (which matches the DeepSeek docs)
    • tool mode: same as non-thinking.

Based on these observations, updated the following for DeepSeek V3.1/3.2 on ChatBedrockConverse:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ChatBedrockConverse prevents DeepSeek V3 from returning text whenever tools are bound (introduced by #688)

1 participant