Skip to content

fix: add header length constraint to question.txt - #8055

Closed
pschiel wants to merge 1 commit into
anomalyco:devfrom
pschiel:question-tool-description
Closed

pschiel wants to merge 1 commit into
anomalyco:devfrom
pschiel:question-tool-description

Conversation

@pschiel

@pschiel pschiel commented Jan 12, 2026

Copy link
Copy Markdown
Contributor

Fixes #7616

Cause: agents sometimes violate the 12-character header limit because JSON Schema constraints like "maxLength": 12 are buried in nested parameter definitions and have lower attention weight compared to prominent natural language instructions in the tool description, causing the LLM occasionally to miss or forget the constraint during generation.

Fix: add it to description text in question.txt

@github-actions

Copy link
Copy Markdown
Contributor

The following comment was made by an LLM, it may be inaccurate:

No duplicate PRs found

@pschiel
pschiel marked this pull request as ready for review January 12, 2026 19:32
@pschiel
pschiel force-pushed the question-tool-description branch 4 times, most recently from 433cd09 to f8e6aaf Compare January 19, 2026 16:13
@pschiel pschiel closed this Jan 20, 2026
@pschiel pschiel reopened this Jan 25, 2026
@pschiel
pschiel force-pushed the question-tool-description branch from f8e6aaf to bbb1f51 Compare January 25, 2026 02:26
@pschiel

pschiel commented Jan 25, 2026 •

Copy link
Copy Markdown
Contributor Author

updated from 12 to 30 according to new schema
(still occasional wrong usage from agent)

@pschiel
pschiel force-pushed the question-tool-description branch from 3f37116 to 9f9879d Compare January 31, 2026 23:17
@pschiel pschiel closed this Feb 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Question tool throws if header length is >= 12 chars

1 participant