Repository navigation
[Outcome Report] Workflow Health — 2026-09-01 #57535
Description
Executive read: The fleet is mostly healthy, but unresolved volume is concentrated in Issue Monster and PR Sous Chef, with Issue Monster showing persistent pending state and PR Sous Chef showing underdefined outcomes.
| Workflow | Status | Lifecycle health | References |
|---|---|---|---|
| Issue Monster | 🟨🟨🟨🟨🟨🟨🟨🟨🟩🟨🟨🟩🟨🟨🟩🟩🟩🟩 | 🔴 stuck | 🟨 #57378 · 🟨 #57373 · 🟨 #57472 · 🟨 #57378 · 🟨 #57375 · 🟨 #57373 · 🟨 #57378 · 🟨 #57373 · 🟩 #57472 · 🟨 #57378 · 🟨 #57373 · 🟩 #57472 · 🟨 #57378 · 🟨 #57373 · 🟩 #57472 · 🟩 #57378 · 🟩 #57373 · 🟩 #57472 |
| PR Sous Chef | 🟩🟨⬜⬜⬜⬜⬜🟨🟩⬜🟩⬜⬜⬜⬜🟨🟩⬜⬜ | ⚪ underdefined | 🟩 #57521 · 🟨 #57526 · ⬜ run 33451668934 · ⬜ run 33450723892 · ⬜ run 33450117047 · ⬜ run 33447300698 · ⬜ run 33446413814 · 🟨 #57514 · 🟩 #57514 · ⬜ run 33445714665 · 🟩 #57514 · ⬜ run 33443759168 · ⬜ run 33442530265 · ⬜ run 33441451961 · ⬜ run 33440704982 · 🟨 #57509 · 🟩 #57509 · ⬜ run 33438636073 · ⬜ run 33437345947 |
| Matt Pocock Skills Reviewer | 🟨🟨🟨🟥 | 🔴 stuck | 🟨 run 33451895107 · 🟨 run 33451895107 · 🟨 run 33451895107 · 🟥 #57521 |
| Auto-Triage Issues | 🟨🟨 | 🟡 in flight | 🟨 run 33448839487 · 🟨 run 33441105868 |
| Contribution Check | ⬜🟨 | 🟡 in flight | ⬜ run 33438199029 · 🟨 #57503 |
| Impeccable Skills Reviewer | 🟨⬜ | 🔴 stuck | 🟨 run 33451895085 · ⬜ #57521 |
| PR Code Quality Reviewer | 🟨⬜ | 🟡 in flight | 🟨 #57521 · ⬜ #57521 |
| Design Decision Gate 🏗️ | 🟨🟩 | 🟡 in flight | 🟨 #57521 · 🟩 #57521 |
| Smoke Copilot MAI | 🟨 | 🔴 stuck | 🟨 #57531 |
| Smoke Copilot SDK | 🟨 | 🔴 stuck | 🟨 #57528 |
| Smoke Pydantic AI | 🟨 | 🔴 stuck | 🟨 #57527 |
| Daily Caveman Optimizer | 🟩 | 🟢 resolving | 🟩 #57509 |
| Daily Observability Report for AWF Firewall and MCP Gateway | ⬜ | 🟢 resolving | ⬜ #57525 |
| Daily Project Performance Summary Generator (Using MCP Scripts) | 🟩⬜ | 🟢 resolving | 🟩 #56964 · ⬜ #57510 |
Legend:
- Status: 🟩 accepted · 🟥 rejected · 🟨 pending · ⬜ unknown
- Lifecycle health: 🟢 resolving · 🟡 in flight · 🟠 aging · 🔴 stuck · ⚪ underdefined
- References: one linked item per status emoji, in the same order as the Status column
🔴 Action Items
- Highest-waste workflows — Matt Pocock Skills Reviewer (25.0%); the highest-waste workflow is the one to review first.
- Stuck pending items — Issue Monster (12 pending vs 8 previously), PR Sous Chef (3 pending vs 1 previously), Matt Pocock Skills Reviewer (3 pending vs 3 previously); these need human review or a workflow timeout.
- Underdefined workflows — PR Sous Chef; add clearer acceptance/rejection criteria or a dedicated evaluator.
- Low zero-touch workflows — Issue Monster (6 accepted, 0 zero-touch), PR Sous Chef (4 accepted, 0 zero-touch), Design Decision Gate 🏗️ (1 accepted, 0 zero-touch); accepted outcomes still need human edits.
- High ignored rate — ignored items are 2/58 (3.4%), below the 30% threshold.
- Data quality — fallback-only evaluations were 0 of 58 outcomes, so the acceptance signal remains strong.
Detailed metrics, evidence quality, workflow counts, and trends
Outcome Scorecard — 2026-09-01
| Metric | Value | Status |
|---|---|---|
| Acceptance rate | 92.9% | 🟢 >80% / 🟡 60-80% / 🔴 <60% |
| Zero-touch rate | 0.0% | 🟢 >50% / 🟡 25-50% / 🔴 <25% |
| Waste rate | 1.7% | 🟢 <10% / 🟡 10-25% / 🔴 >25% |
| Median time to resolution | 15m | — |
| Accepted | 13 / 58 | — |
| — strong evidence | 3 | merged, completed, approved |
| — medium evidence | 10 | engaged, retained |
| — weak evidence | 0 | existence only |
| Rejected | 1 | — |
| Ignored | 2 | no observable follow-up |
| Zero-touch | 0 / 13 | — |
| Pending | 27 | — |
| Runs checked | 32 | — |
Per-Workflow Breakdown
| Workflow | Accepted | Rejected | Ignored | Pending | Acceptance | Zero-touch |
|---|---|---|---|---|---|---|
| Matt Pocock Skills Reviewer | 0 | 1 | 0 | 3 | 0.0% | 0 |
| Issue Monster | 6 | 0 | 0 | 12 | 33.3% | 0 |
| PR Sous Chef | 4 | 0 | 0 | 3 | 21.1% | 0 |
| Auto-Triage Issues | 0 | 0 | 0 | 2 | 0.0% | 0 |
| Contribution Check | 0 | 0 | 0 | 1 | 0.0% | 0 |
| Design Decision Gate 🏗️ | 1 | 0 | 0 | 1 | 50.0% | 0 |
| Impeccable Skills Reviewer | 0 | 0 | 0 | 1 | 0.0% | 0 |
| PR Code Quality Reviewer | 0 | 0 | 0 | 1 | 0.0% | 0 |
| Smoke Copilot MAI | 0 | 0 | 0 | 1 | 0.0% | 0 |
| Smoke Copilot SDK | 0 | 0 | 0 | 1 | 0.0% | 0 |
| Smoke Pydantic AI | 0 | 0 | 0 | 1 | 0.0% | 0 |
| Daily Caveman Optimizer | 1 | 0 | 0 | 0 | 100.0% | 0 |
| Daily Observability Report for AWF Firewall and MCP Gateway | 0 | 0 | 1 | 0 | 0.0% | 0 |
| Daily Project Performance Summary Generator (Using MCP Scripts) | 1 | 0 | 1 | 0 | 50.0% | 0 |
Evidence Quality
No outcomes were evaluated with fallback-only evidence.
Trend Signal
- ➡️ Stable: acceptance rate and zero-touch rate were within the prior report band.
Warning
Firewall blocked 1 domain
The following domain was blocked by the firewall during workflow execution:
ab.chatgpt.com
To allow these domains, add them to the network.allowed list in your workflow frontmatter:
network:
allowed:
- defaults
- "ab.chatgpt.com"See Network Configuration for more information.
📊 Measured by Outcome Collector · codex · mai10 · 23.7 AIC · ⌖ 0.601 AIC · ⊞ 16.7K
- expires on Sep 7, 2026, 4:26 PM UTC-08:00
Activity
github-actions commentedon Sep 7, 2026
This issue is being closed as outdated. A newer issue has been created: #59062
View newer issue
This action was performed automatically by the
Outcome Collectorworkflow.