You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Summary: Engine type errors produce high-quality messages with valid values and examples. However, nested tools.github.toolsets type errors surface only a terse "got string, want array" message with no guidance on valid toolset names or correct array syntax — leaving developers without actionable help.
Analysis performed via static code review of pkg/parser/schema_compiler.go, pkg/parser/schema_errors.go, and the embedded main_workflow_schema.json since binary execution was unavailable in the sandbox.
Test
Workflow
Error Type
Score
Rating
1
research.md
engine: 123 (wrong type)
82/100
✅ Good
2
agent-performance-analyzer.md
toolsets: "default" (string not array)
54/100
❌ Poor
Strengths
Engine type errors are excellent: synthesizeOneOfTypeConflictMessage + knownOneOfFieldHints["/engine"] produce "expected string or object, got number. Valid engine names: claude, codex, copilot, gemini." with an example — actionable and complete.
Precise file:line:col location is attached to every schema error.
Weaknesses (top 3)
No hints for /tools/github/toolsets — knownOneOfFieldHints in pkg/parser/schema_errors.go only has an entry for /engine. A type mismatch at /tools/github/toolsets produces only "got string, want array" with zero guidance on valid values.
Fix: Add to knownOneOfFieldHints: "/tools/github/toolsets": "Valid toolsets: all, default, action-friendly, repos, issues, pull_requests, actions, code_security.\n\nExample:\ntools:\n github:\n toolsets: [default]"
No field example for toolsets — getFieldExample in pkg/workflow/schema_validation.go has examples for top-level fields but nothing for nested paths like toolsets. The generic array fallback only adds Example: toolsets: [item1, item2] which is unhelpful.
Fix: Expand fieldExamples to include "tools.github.toolsets" or use the schema enum values to auto-generate the hint.
Engine example only shows string form — knownOneOfFieldHints["/engine"] shows engine: copilot but omits the object form engine: {id: copilot, model: ...}, leaving users discovering it via docs.
Fix: Add a second example line: # or with options:\nengine:\n id: copilot\n max-turns: 15
Activity
pelikhan commentedon Apr 29, 2026
@copilot add support for single string toolset field value