From b64f13235b4b58c620666d690680e414920c964b Mon Sep 17 00:00:00 2001 From: Peli de Halleux Date: Sun, 11 Oct 2026 09:04:12 -0700 Subject: [PATCH 1/5] Fix deterministic work-queue portfolio submission (#67648) * Fix deterministic work queue portfolio submission Stage prepared portfolio plans before agent execution, reject missing dispatcher intents, and use the standard ESLint launch credential fallback. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> * Use Actions token for ESLint queue worker dispatch Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> * Suppress remaining telemetry context in dry-run workflows Filter W3C trace context, internal OTEL IDs, and engine telemetry overrides before rendering dry-run workflows and native engine configuration. Preserve normal compilation and document the compiler-managed scope. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> * Seal prepared work-queue intent batches Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com> * Record dry-run state in workflow lock metadata Serialize dry_run:true for development locks, preserve normal and older lock compatibility, and verify metadata round trips and repeated compilation. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> * Require one security reviewer and annotated Markdown overview Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: gh-aw-bot <259018956+gh-aw-bot@users.noreply.github.com> --- .github/aw/debug-agentic-workflow.md | 3 +- .github/aw/debug-security-review.md | 88 ++++++++++++------- .github/aw/work-queue.md | 27 +++--- .../agentic-workflows/tests/test_guidance.py | 24 +++++ .github/skills/debugging-workflows/SKILL.md | 7 ++ .../skills/review-agentic-workflows/SKILL.md | 14 ++- .github/workflows/artifacts-summary.lock.yml | 2 +- .../workflows/daily-code-debt-aider.lock.yml | 4 +- .github/workflows/daily-evals-report.lock.yml | 2 +- .../workflows/daily-firewall-report.lock.yml | 2 +- .../daily-go-test-stubs-aider.lock.yml | 4 +- .../workflows/daily-issues-report.lock.yml | 4 +- .../daily-observability-report.lock.yml | 2 +- .github/workflows/daily-regulatory.lock.yml | 2 +- .../workflows/daily-repo-chronicle.lock.yml | 2 +- .../daily-report-dispatcher.lock.yml | 13 ++- .github/workflows/daily-report-dispatcher.md | 13 ++- .../workflows/daily-secrets-analysis.lock.yml | 2 +- .../daily-team-evolution-insights.lock.yml | 2 +- .../daily-token-consumption-report.lock.yml | 2 +- .github/workflows/deep-report.lock.yml | 4 +- .../engine-conformance-aider.lock.yml | 4 +- .../engine-conformance-dispatcher.lock.yml | 13 ++- .../engine-conformance-dispatcher.md | 13 ++- .../eslint-factory-dispatcher.lock.yml | 22 +++-- .../workflows/eslint-factory-dispatcher.md | 36 ++++---- .github/workflows/repo-tree-map.lock.yml | 2 +- .github/workflows/shared/aider.md | 2 +- .../workflows/shared/daily-report-worker.md | 5 +- .../shared/work-queue-staged-plan.md | 9 ++ .github/workflows/smoke-aider.lock.yml | 4 +- .../setup/js/daily_report_portfolio.test.cjs | 3 + .../js/engine_conformance_portfolio.test.cjs | 3 + .../js/eslint_factory_portfolio.test.cjs | 58 +++++++----- actions/setup/js/work_queue_dispatch.cjs | 13 ++- actions/setup/js/work_queue_dispatch.test.cjs | 45 +++++++++- .../js/work_queue_documentation.test.cjs | 7 +- actions/setup/js/work_queue_intents.cjs | 56 +++++++++++- actions/setup/js/work_queue_intents.test.cjs | 80 ++++++++++++++++- .../docs/patterns/daily-report-portfolio.md | 26 ++++-- .../docs/reference/compilation-process.md | 7 +- .../compiler_development_telemetry.go | 16 +++- .../compiler_development_telemetry_test.go | 59 +++++++++++-- pkg/workflow/compiler_yaml_header.go | 31 +++---- pkg/workflow/lock_schema.go | 7 +- pkg/workflow/lock_schema_test.go | 24 +++++ 46 files changed, 592 insertions(+), 176 deletions(-) create mode 100644 .github/workflows/shared/work-queue-staged-plan.md diff --git a/.github/aw/debug-agentic-workflow.md b/.github/aw/debug-agentic-workflow.md index 83668902ec5..6446539cfb2 100644 --- a/.github/aw/debug-agentic-workflow.md +++ b/.github/aw/debug-agentic-workflow.md @@ -166,7 +166,8 @@ rather than skipping them; review callees separately without the override. push jobs, memory/cache persistence, reusable safe-output calls, work-queue operations, reactions, status/failure comments and issues, label removal, and issue locking. Diagnostics, summaries, and run artifacts remain available; -`OTEL_*` and `GH_AW_OTLP_*` environment variables and automatic telemetry +`OTEL_*`, `GH_AW_OTLP_*`, `GITHUB_AW_OTEL_*`, `TRACEPARENT`, `TRACESTATE`, +`BAGGAGE`, and `CLAUDE_CODE_ENABLE_TELEMETRY` environment variables and automatic telemetry configuration/authentication are omitted from dry-run locks. Custom scripts that configure their own exporters remain outside this control. Review that emitted lock, not the previously published normal lock. If a live diff --git a/.github/aw/debug-security-review.md b/.github/aw/debug-security-review.md index 37f00d02c3b..0e75731e4c9 100644 --- a/.github/aw/debug-security-review.md +++ b/.github/aw/debug-security-review.md @@ -1,5 +1,5 @@ --- -description: Gate local debug/dry-run changes with 2-3 independent cheap security judges. +description: Gate local debug/dry-run changes with one read-only security reviewer and an annotated Markdown-source overview. disable-model-invocation: true --- @@ -29,12 +29,12 @@ security checks. A passing dry-run still grants no live-dispatch permission. ## Agent Ownership The agent performs the review: capture intent, inspect source and reachable -runtime dependencies, prepare the evidence packet, run independent judges, +runtime dependencies, prepare the evidence packet, engage one security reviewer, resolve findings and missing coverage, execute permitted compilation/scanners, and record the result. Do not hand these steps to the user as a checklist. -An incomplete judge response is missing review evidence, not a confirmed +An incomplete reviewer response is missing review evidence, not a confirmed vulnerability or a reason to ask the user to inspect code. Gather the missing -evidence within the judge limits below; never turn UNKNOWN into PASS. +evidence with the same reviewer; never turn UNKNOWN into PASS. The agent also prepares exact revisions, hashes, credential-source/destination metadata, permissions, protections and run bounds for any required human @@ -91,7 +91,7 @@ The agent may run the installed, trusted `gh aw compile WORKFLOW --dry-run` to obtain emitted locks and compiler/scanner evidence before the final source/lock review. This permission covers compilation, not execution of workflow scripts, changed compiler code, build hooks, harnesses or MCP servers. -Review those separately before running them. The judges remain read-only. +Review those separately before running them. The reviewer remains read-only. Emission is required: do not combine `--dry-run` with `--no-emit`. Compilation may run in the current checkout; a disposable checkout is optional, not a @@ -113,8 +113,8 @@ the diagnostic lock's review verdict to a different live lock. request: goal, permitted scope/effects, preserved behavior and acceptance criteria. For an existing session, capture before further edits/execution. - Cite the originating user message and subsequent explicit user clarifications. - Store the concise intent record in session artifacts; give every judge the - same record. Do not copy unrelated or sensitive conversation content. + Store the concise intent record in session artifacts; give the reviewer that + record. Do not copy unrelated or sensitive conversation content. - Clarification optional: if goal/scope/authorization is unclear and the user is available, ask one focused question. Do not wait indefinitely for an absent user. Record unresolved intent as UNKNOWN; continue static diagnosis and @@ -139,24 +139,22 @@ the diagnostic lock's review verdict to a different live lock. - No execution, installs, server startup or destination contact. Missing/truncated relevant code = UNKNOWN coverage. -## Judges - -- Select smallest/cheapest available code-classification models through supported - runtime controls. No guessed IDs or silent expensive defaults. Record actual - models; prefer distinct cheap models. -- Launch two independent read-only subagents in parallel: same packet/questions, - one bounded pass each, small response budget, runtime-supported timeout. - No nested agents, execution, external writes or shared answers. -- Disagreement/abstention: third independent cheap judge reviews disputed questions - against the same packet, blind to earlier votes. Maximum three judges/revision, - not per question. No favorable-vote retries. -- Cheap selection/read-only agents unavailable: gate UNAVAILABLE, never PASS. +## Single Reviewer + +- Require exactly one read-only security-review agent for the current revision. + Give it the intent, evidence packet and questions below for one bounded pass. + No parallel judges, voting, tie-breakers, nested agents, execution or external writes. +- Use the configured runtime model defaults; do not guess or require model IDs. + Record the actual model if exposed, otherwise report it as unavailable. +- Resolve incomplete coverage or questions through bounded follow-ups with the + same reviewer. Do not launch replacement reviewers to obtain a favorable verdict. +- If a read-only reviewer is unavailable, the gate is UNAVAILABLE, never PASS. Continue static diagnosis/editing; no unreviewed execution. ## Binary Questions [BinEval-style](evals.md): one falsifiable claim/question; YES = property holds. -Judge code evidence, not reported success. Local prompts, not workflow `evals:` +Review code evidence, not reported success. Local prompts, not workflow `evals:` or hosted runs. Scope every question to reachable changed behavior. | ID | Question (YES = safe property) | @@ -176,7 +174,7 @@ Seek exfiltration (encoded/covert included), malware, download-and-execute, obfuscation, backdoors, unauthorized persistence, destructive effects and suspicious/insecure code. Unfamiliar syntax alone proves no maliciousness. -Each judge returns one record/question: +The reviewer returns one record/question: ```text question_id: @@ -185,21 +183,19 @@ evidence: path:lines; credential source -> sink/destination or relevant control reason: ``` -UNKNOWN = abstention: missing evidence/unresolved applicability, never success. +UNKNOWN = missing evidence/unresolved applicability, never success. Absent path: YES only with code-grounded not-applicable explanation. ## Decision -- Compare 2-3 answers/question side by side: model, vote, evidence, disagreement. - Agreement (2/2 or 2/3) = triage signal, not security proof. - Parent inspects every NO: trace source-to-sink/unsafe effect; resolve through - code evidence or fix. Never outvote credible minority findings. Resolve UNKNOWN - coverage explicitly; third YES cannot supply missing evidence. -- PASS only if every question has two evidence-backed YES votes, all negative + code evidence or fix. Resolve UNKNOWN coverage explicitly with the same reviewer; + an unsupported affirmative answer cannot supply missing evidence. +- PASS only if every question has an evidence-backed YES from the single reviewer, all negative findings resolved, relevant coverage complete. - Otherwise block affected execution/upload; continue read-only diagnosis/fixes. - Unresolved suspicion: focused security review, not endless judge debate. -- Report session intent/provenance, base/hashes, models, votes, confirmed findings with paths/lines, + Unresolved suspicion remains blocked; do not retry reviewers or debate indefinitely. +- Report session intent/provenance, base/hashes, reviewer/model, answers, confirmed findings with paths/lines, unresolved evidence and PASS/BLOCKED/UNAVAILABLE. Store in session artifacts; never commit raw logs. - Intent/code/import/dependency/lock changes invalidate affected verdicts. Review new @@ -214,13 +210,41 @@ Report this even when nothing was found; incomplete coverage is not a clean bill of health. Include it in the user handoff, not only in private artifacts or judge replies, and do not imply that review authorizes execution. +### Annotated Markdown Change Overview + +Alongside every review result, show the user an annotated overview of changed +authored `.md` sources, including workflow frontmatter, executable snippets, +prompts, imports, and review guidance. Ignore generated `.lock.yml` files in +this overview; do not reproduce their diffs or annotate generated YAML lines. +Generated locks remain execution-review evidence, not the user-facing source overview. + +For each security-relevant source change, provide a revision-pinned Markdown +link and line range, the before/after behavior, and a plain-language annotation +explaining its security impact: credentials and recipients, permissions, output +limits, untrusted-input boundaries, executable provenance, persistence, sandbox +controls or approval requirements. Distinguish improved, unchanged and weakened +controls from unresolved evidence. Explain the practical effect rather than merely +restating the changed text. Redact secret values. + +Use a compact table: + +| Markdown source | Change | Security impact | +| --- | --- | --- | +| [workflow.md:10–14]() | Custom-token-only launch becomes Actions-token fallback. | Removes the custom-secret dependency; approved routes and privileged-job permission checks remain required. | + +If no authored Markdown changed, say so and summarize the relevant code changes +without inventing a source diff. This overview is required even when there are +no findings or the review is blocked; it does not replace the evidence or findings. +Show it in the user response, not only in a private artifact, and do not modify +reviewed workflow Markdown merely to insert annotations. + Example: "Security review passed for the emitted dry-run lock: credential flows, executable provenance, and sandbox controls were checked, with no confirmed issues." ### Explain Blocked or Unavailable Debugging A refusal must explain **why** the requested execution or upload is blocked. -"Security review failed", "inconsistent judgments", or "missing coverage" alone +"Security review failed" or "missing coverage" alone is not an actionable explanation. After the result sentence, identify each material blocker: @@ -243,13 +267,13 @@ Metadata alone does not establish a missing firewall; inspect the actual AWF configuration and invocation. Distinguish unchanged intentional controls from new regressions. Apply the [dry-run dangerous-feature filter](#dry-run-dangerous-features) to authored workflow configuration, not built-in engine implementation flags. -Explain contradictory vote/reason pairs without silently changing votes or +Explain contradictory answer/reason pairs without silently changing answers or counting them as a passed gate. When no code defect is confirmed, say so. Link the gate that requires withholding execution and identify the unresolved question and missing evidence instead of inventing a problematic source line. For example: "Live dispatch is blocked by -the [two-affirmative-vote requirement](#decision): `secret_disclosure` has unresolved +the [single-reviewer evidence requirement](#decision): `secret_disclosure` has unresolved review coverage for the [artifact redaction path](). No credential leak is confirmed. The agent must resolve that source coverage before dispatch; additional user authorization cannot replace the review." diff --git a/.github/aw/work-queue.md b/.github/aw/work-queue.md index 81964f22825..8f6c34ac663 100644 --- a/.github/aw/work-queue.md +++ b/.github/aw/work-queue.md @@ -6,7 +6,7 @@ description: Agent instructions for Git-backed work queue producers, dispatchers `tools.work-queue` schedules immutable DAGs and Claim-scoped effects; `work-queue.jsonl` is authoritative. V3 has no storage selector; Issues/PRs are -dependencies. Weights distribute Claim opportunities, not CPU/completions. +dependencies. For issue-backed WorkQueueOps, see [WorkQueueOps](../../docs/src/content/docs/patterns/workqueue-ops.md). ## Select the role @@ -17,10 +17,10 @@ For issue-backed WorkQueueOps, see [WorkQueueOps](../../docs/src/content/docs/pa - **Worker:** require compiler-supplied version-3 `claims`; never override reserved `work_queue_assignment` or caller context. -Trust compiler/runtime role, not snapshot metadata; don't downgrade workers. -AW authenticates run/workflow/revision; reruns cannot inherit attempt 1. -An absent branch is uninitialized/empty. Its first producer submit atomically -creates it with compiled Policy and Work; reads and dispatch alone never do. +Trust runtime roles, not snapshots; AW authenticates the native run, workflow and +revision; reruns cannot inherit attempt 1. +An absent branch is uninitialized/empty; the first producer submit atomically +creates compiled Policy and Work. Reads and dispatch alone never do. Reject malformed or unsupported existing logs. ## Configure deployment @@ -45,7 +45,6 @@ use one default pool, weighted-priority, concurrency 16, pending 4,096, singleton assignments and three attempts with 30-second backoff. First submit automatically installs compiled Policy and Work. Standalone seeding is unsupported; AW and Actions authorize the trusted submission. -No producer enrollment, principal or credential settings are needed. Economic Policy updates require quiescence and explicit `policy --from-config --epoch EPOCH`; config edits never rewrite active state. Compatible deployments evolve future execution without draining. @@ -76,6 +75,10 @@ Upgrade all closed-schema readers first. See the - Trusted processing refreshes the ledger and commits a compatible fair prefix. CAS losers discard tentative choices/charges and recompute. +ESLint, daily-report and conformance agents explain staged plans only. +Trusted controls validate the batch; empty dispatcher intents fail. +Unassigned dispatchers cannot emit `noop` or `report_incomplete`. + ## Execute original Claims - Process only the assignment's original Claims and stored plans. Scope every @@ -86,16 +89,14 @@ Upgrade all closed-schema readers first. See the - Finish each member with `work_queue_claim_finish`, using `outcome: "completed"` or `"cancelled"`. Missing finish authorizes no effects; valid siblings settle independently. -- Default to one Claim. Enable batching only for compatible Work with substantial - reusable setup; never treat the batch's native conclusion as every Work's Result. +- Default to one Claim; batch only compatible Work with reusable setup. A native + batch conclusion is not every Work's Result. - Treat finish as an intent: trusted processing publishes Completion before scoped effects and Result only after independently verified delivery. -Use `` subcommands with one JSON argument. -`uninitialized` plus null SHA is empty; -first `work_queue_submit` atomically installs compiled Policy and Work. Submit -before dispatch. Existing policyless ledgers are failures; workers require -Policy. `status: "staged"` is no grant or launch. +Use `` with one JSON argument. `uninitialized` plus null SHA is empty; +first `work_queue_submit` installs Policy and Work. Submit before dispatch. +Policyless ledgers fail; workers require Policy; `status: "staged"` is no grant. ## Dependencies and recovery diff --git a/.github/skills/agentic-workflows/tests/test_guidance.py b/.github/skills/agentic-workflows/tests/test_guidance.py index 0be9a1a7d93..1ef78805d92 100644 --- a/.github/skills/agentic-workflows/tests/test_guidance.py +++ b/.github/skills/agentic-workflows/tests/test_guidance.py @@ -17,6 +17,30 @@ def checklist(text): class GuidanceTests(unittest.TestCase): + def test_single_security_reviewer_and_markdown_overview(self): + gate = (ROOT / ".github/aw/debug-security-review.md").read_text() + self.assertIn("exactly one read-only security-review agent", gate) + self.assertIn("same reviewer", gate) + self.assertIn("every question has an evidence-backed YES", gate) + self.assertIn("## Single Reviewer", gate) + self.assertIn("### Annotated Markdown Change Overview", gate) + self.assertIn("Ignore generated `.lock.yml` files in", gate) + self.assertIn("Generated locks remain execution-review evidence", gate) + self.assertIn("Show it in the user response", gate) + self.assertIn("| Markdown source | Change | Security impact |", gate) + for obsolete in ( + "Launch two independent", "third independent cheap judge", + "two evidence-backed YES votes", "two-affirmative-vote requirement", + ): + self.assertNotIn(obsolete, gate) + for skill in ("debugging-workflows", "review-agentic-workflows"): + with self.subTest(skill=skill): + text = (ROOT / f".github/skills/{skill}/SKILL.md").read_text() + self.assertIn("debug-security-review.md#single-reviewer", text) + self.assertIn( + "debug-security-review.md#annotated-markdown-change-overview", text + ) + def test_customer_case_remedy_order(self): case = FIXTURES["model_mismatch"] self.assertIn("v0.89.21", case["lock_header"]) diff --git a/.github/skills/debugging-workflows/SKILL.md b/.github/skills/debugging-workflows/SKILL.md index 65c69472181..9d6fa5706be 100644 --- a/.github/skills/debugging-workflows/SKILL.md +++ b/.github/skills/debugging-workflows/SKILL.md @@ -15,6 +15,13 @@ reference, not a separate execution policy. Respect explicit no-dispatch context Apply its live-outcome table, credential triage and untrusted-evidence rules. Without accessible existing logs, use source/fixtures; never dispatch for evidence. +Require one read-only security-review agent per revision, not multiple judges. +Show the user an annotated overview of changed authored `.md` sources explaining +their security impacts; ignore `.lock.yml` diffs in that overview while retaining +generated locks as execution-review evidence. Follow the shared +[single-reviewer](../../aw/debug-security-review.md#single-reviewer) and +[annotated overview](../../aw/debug-security-review.md#annotated-markdown-change-overview) rules. + Workflow registration/activation and secret presence, validity, or expiry are runtime readiness checks, not pre-dispatch prerequisites. Do not require workflow or secret inventories or organization-admin metadata access. An otherwise diff --git a/.github/skills/review-agentic-workflows/SKILL.md b/.github/skills/review-agentic-workflows/SKILL.md index 2394912ea82..dd267db1b39 100644 --- a/.github/skills/review-agentic-workflows/SKILL.md +++ b/.github/skills/review-agentic-workflows/SKILL.md @@ -18,7 +18,7 @@ Reference workflow authoring skill guidance at: https://raw.githubusercontent.co ## Agent ownership The agent performs setup, source and runtime-dependency inspection, independent -review coordination when required, compilation/scanners, evidence collection, +single-reviewer coordination, compilation/scanners, evidence collection, finding resolution and cleanup. Do not give the user a technical preflight checklist to execute. Report concrete blockers and request only authorization or decisions the agent cannot supply. For debugging and live-test gates, follow @@ -26,6 +26,11 @@ the [shared security-review guidance](../../aw/debug-security-review.md); the agent prepares the evidence for human validation rather than asking the user to conduct the review. +Require exactly one read-only security-review agent per reviewed revision. +Resolve coverage questions with that reviewer; do not require parallel judges, +majority votes or a tie-breaker. Follow the shared +[single-reviewer rules](../../aw/debug-security-review.md#single-reviewer). + The user may explicitly authorize live debugging for the current session rather than approve each run. Record the grant and agreed scope/bounds; reuse it for in-scope revisions only after the agent repeats the required technical review. @@ -152,6 +157,13 @@ Recommend minimal, safe optimizations that keep or improve security posture. ## Review output contract +Show an annotated overview of changed authored `.md` files, excluding generated +`.lock.yml` diffs from the overview. Link source lines, describe before/after +behavior, and explain the security impact of each relevant change in plain +language. Include preserved controls and unresolved evidence, not just findings. +Keep generated locks in the execution-review evidence. Follow the shared +[annotated overview contract](../../aw/debug-security-review.md#annotated-markdown-change-overview). + Always provide a short user-visible result sentence for each security review and dry-run attempt, including failed, blocked, or unavailable checks. State the artifact/scope, outcome, what was actually checked, and any material finding or diff --git a/.github/workflows/artifacts-summary.lock.yml b/.github/workflows/artifacts-summary.lock.yml index fc201c786d3..146385cb8e8 100644 --- a/.github/workflows/artifacts-summary.lock.yml +++ b/.github/workflows/artifacts-summary.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"b9fd281736a4a71be0e2e4e9e2ae4cd46564e181fc20872177b678bec81150d1","body_hash":"47a84084361a76230e650a47e6d284422ed7dbf69beeef05c1f15af8dc42f08e","strict":true,"agent_id":"codex","agent_model":"openai/gpt-6-luna","engine_versions":{"codex":"0.159.3"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"b9fd281736a4a71be0e2e4e9e2ae4cd46564e181fc20872177b678bec81150d1","body_hash":"1601de2addf59a53b608246081a6377d0cdbf84cdf919f44c4de768160cbafa6","strict":true,"agent_id":"codex","agent_model":"openai/gpt-6-luna","engine_versions":{"codex":"0.159.3"}} # gh-aw-manifest: {"version":1,"secrets":["CODEX_API_KEY","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN","OPENAI_API_KEY"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["actions_get","actions_list","get_commit","get_file_contents","get_job_logs","get_latest_release","get_release_by_tag","get_tag","list_branches","list_commits","list_releases","list_starred_repositories","list_tags","search_code","search_repositories"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-code-debt-aider.lock.yml b/.github/workflows/daily-code-debt-aider.lock.yml index 36485420676..215e67212c2 100644 --- a/.github/workflows/daily-code-debt-aider.lock.yml +++ b/.github/workflows/daily-code-debt-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"becf6b4f19b18ef07d348b39957fd127b593b346cee9c6bba5921bcfe8782e65","body_hash":"7b39053084c924dcdd876e1a211d1927477965fc6f51da48e3dbfa5316ee328b","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"87ea2155e4df859269fb1b9dbdda93dbb628c5f17e612f7db9f24ce1732ad963","body_hash":"7b39053084c924dcdd876e1a211d1927477965fc6f51da48e3dbfa5316ee328b","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_CI_TRIGGER_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_pull_request","missing_data","missing_tool","noop","report_incomplete"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1055,7 +1055,7 @@ jobs: "pi.message_snapshot", ]); const isInterpreted = entry => interpretedTypes.has(entry.type) || - entry.type.startsWith("subagent."); + entry.type.startsWith("subagent.") || entry.type.startsWith("otel."); const logEntries = (parseLogEntries(logContent) || []).filter( entry => isSessionEvent(entry) && ( entry.data.sourceEngine === "aider" || diff --git a/.github/workflows/daily-evals-report.lock.yml b/.github/workflows/daily-evals-report.lock.yml index 292e5be1f7a..e7c2a4d5562 100644 --- a/.github/workflows/daily-evals-report.lock.yml +++ b/.github/workflows/daily-evals-report.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"4b2fc392baf969e0e3cc4e6f3ff0d228c11f1cd1cb82b18e46c63579082e4772","body_hash":"66f0629e5b63b80c1a2d1480c0d9442422f36862e4703eadcd7335c06c70de84","strict":true,"agent_id":"codex","agent_model":"copilot/gpt-5.6-sol","engine_versions":{"codex":"0.159.3"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"4b2fc392baf969e0e3cc4e6f3ff0d228c11f1cd1cb82b18e46c63579082e4772","body_hash":"6f9884f8960249fced35e03d14fb41f9e83e8fd634d38754b691394523c391a0","strict":true,"agent_id":"codex","agent_model":"copilot/gpt-5.6-sol","engine_versions":{"codex":"0.159.3"}} # gh-aw-manifest: {"version":1,"secrets":["COPILOT_GITHUB_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-go","sha":"b7ad1dad31e06c5925ef5d2fc7ad053ef454303e","version":"v7.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"},{"repo":"docker/build-push-action","sha":"c3c9e263c25d99ce0380d002d59b67737d91b0dc","version":"v7.4.0"},{"repo":"docker/setup-buildx-action","sha":"f87e5991a6d7451dcb8d9637bfbc97413f497069","version":"v4.4.1"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"agenticworkflows","tools":["*"]},{"name":"github","tools":["actions_get","actions_list","get_commit","get_file_contents","get_job_logs","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-firewall-report.lock.yml b/.github/workflows/daily-firewall-report.lock.yml index e6e46ef020d..7865349b9ec 100644 --- a/.github/workflows/daily-firewall-report.lock.yml +++ b/.github/workflows/daily-firewall-report.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"72358591e8a5f81ecd017c6f0f1ba4ca3b5b932766fde071d28e56a25a98a313","body_hash":"526af3b2c7b85827e793427282499403491a1fa1f860d04f803680e9b007ead4","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"72358591e8a5f81ecd017c6f0f1ba4ca3b5b932766fde071d28e56a25a98a313","body_hash":"7285487825184c5e3bb6a0fe499f7ad12238a5961cbbb0b5d9aac2891c1896a2","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} # gh-aw-manifest: {"version":1,"secrets":["COPILOT_GITHUB_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/cache/restore","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/cache/save","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-go","sha":"b7ad1dad31e06c5925ef5d2fc7ad053ef454303e","version":"v7.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"},{"repo":"docker/build-push-action","sha":"c3c9e263c25d99ce0380d002d59b67737d91b0dc","version":"v7.4.0"},{"repo":"docker/setup-buildx-action","sha":"f87e5991a6d7451dcb8d9637bfbc97413f497069","version":"v4.4.1"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"agenticworkflows","tools":["*"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete","upload_asset"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-go-test-stubs-aider.lock.yml b/.github/workflows/daily-go-test-stubs-aider.lock.yml index a6af8ee29c0..a53b56bd188 100644 --- a/.github/workflows/daily-go-test-stubs-aider.lock.yml +++ b/.github/workflows/daily-go-test-stubs-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"43085e285e0ec2ade145546111e6aeefe6c46592d82130ef0ff8ed053b6f6b7d","body_hash":"99eb80ec2bce3938e2af26781db1b953a94cbe316d91805fc07cde14c6ecd1b9","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"af8325aabf8dcbb0efbfaf31f082b00591fa492d3354ad00d1b3f1478b793059","body_hash":"99eb80ec2bce3938e2af26781db1b953a94cbe316d91805fc07cde14c6ecd1b9","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_CI_TRIGGER_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_pull_request","missing_data","missing_tool","noop","report_incomplete"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1055,7 +1055,7 @@ jobs: "pi.message_snapshot", ]); const isInterpreted = entry => interpretedTypes.has(entry.type) || - entry.type.startsWith("subagent."); + entry.type.startsWith("subagent.") || entry.type.startsWith("otel."); const logEntries = (parseLogEntries(logContent) || []).filter( entry => isSessionEvent(entry) && ( entry.data.sourceEngine === "aider" || diff --git a/.github/workflows/daily-issues-report.lock.yml b/.github/workflows/daily-issues-report.lock.yml index 1afde127c7f..2b7cfb28428 100644 --- a/.github/workflows/daily-issues-report.lock.yml +++ b/.github/workflows/daily-issues-report.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"b01bd4c504f9a05abe3c81bba035ed964b020ef6ecbbcfdb464fad46dad86919","body_hash":"884bcc0457bb5d5fdebed6834eee3c96a5f75d671605ce9b027c0368b6459521","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90","copilot-sdk":"1.0.16"},"agent_image_runner":"aw-gpu-runner-T4"} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"b01bd4c504f9a05abe3c81bba035ed964b020ef6ecbbcfdb464fad46dad86919","body_hash":"5e25477499010dfa1b1786445023db153c3d83b7bde58ebbd9422ba333ef43bc","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90","copilot-sdk":"1.0.16"},"agent_image_runner":"aw-gpu-runner-T4"} # gh-aw-manifest: {"version":1,"secrets":["COPILOT_GITHUB_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/cache/restore","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/cache/save","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"},{"repo":"astral-sh/setup-uv","sha":"1c37ad07a6a961277cf70c0d37d6f313000f5884","version":"v10.3.0"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete","upload_asset"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -183,7 +183,7 @@ jobs: GH_AW_EXPERIMENT_SPEC: '{"output_format":{"variants":["collapsible","inline","ste"],"description":"Test whether hiding report details behind a \u003cdetails\u003e block, presenting them inline, or writing in Simplified Technical English (STE) affects discussion engagement","hypothesis":"H0: no change in discussion engagement score. H1: inline format produces ≥20% higher reactions+replies by making charts and recommendations immediately visible; ste format improves engagement via clearer, simpler language.","metric":"discussion_engagement_score","secondary_metrics":["output_length_chars","run_duration_ms","eval:output_format_adherence"],"guardrail_metrics":[{"name":"empty_output_rate","threshold":"==0"}],"min_samples":30,"weight":[34,33,33],"issue":30573,"start_date":"2026-05-07","analysis_type":"mann_whitney","tags":["output","readability","engagement"]}}' GH_AW_EXPERIMENT_STATE_FILE: /tmp/gh-aw/experiments/state.jsonl GH_AW_EXPERIMENT_STATE_DIR: /tmp/gh-aw/experiments - GH_AW_HARNESS_VERSION: b01bd4c504f9a05abe3c81bba035ed964b020ef6ecbbcfdb464fad46dad86919:884bcc0457bb5d5fdebed6834eee3c96a5f75d671605ce9b027c0368b6459521 + GH_AW_HARNESS_VERSION: b01bd4c504f9a05abe3c81bba035ed964b020ef6ecbbcfdb464fad46dad86919:5e25477499010dfa1b1786445023db153c3d83b7bde58ebbd9422ba333ef43bc with: script: | const path = require('path'); diff --git a/.github/workflows/daily-observability-report.lock.yml b/.github/workflows/daily-observability-report.lock.yml index d1d0dd87819..60227d17393 100644 --- a/.github/workflows/daily-observability-report.lock.yml +++ b/.github/workflows/daily-observability-report.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"9e40767f5a49a5397a51d2f3118e040e7c20f4f43f7f87441df660ae6d61a095","body_hash":"670931fa3caff75dcca59e9158879f9ac9a40eba3444bf2ba4aaf5159b676e36","strict":true,"agent_id":"codex","agent_model":"gpt-5.3-codex","engine_versions":{"codex":"0.159.3"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"9e40767f5a49a5397a51d2f3118e040e7c20f4f43f7f87441df660ae6d61a095","body_hash":"b373c2cdbacfb3788da2acd7d3fa67a56ff83e9b3b251e0ae3cf434bb161e8b8","strict":true,"agent_id":"codex","agent_model":"gpt-5.3-codex","engine_versions":{"codex":"0.159.3"}} # gh-aw-manifest: {"version":1,"secrets":["CODEX_API_KEY","COPILOT_GITHUB_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN","OPENAI_API_KEY"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-go","sha":"b7ad1dad31e06c5925ef5d2fc7ad053ef454303e","version":"v7.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"},{"repo":"docker/build-push-action","sha":"c3c9e263c25d99ce0380d002d59b67737d91b0dc","version":"v7.4.0"},{"repo":"docker/setup-buildx-action","sha":"f87e5991a6d7451dcb8d9637bfbc97413f497069","version":"v4.4.1"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"agenticworkflows","tools":["*"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-regulatory.lock.yml b/.github/workflows/daily-regulatory.lock.yml index 25328d072bd..7213d7673e6 100644 --- a/.github/workflows/daily-regulatory.lock.yml +++ b/.github/workflows/daily-regulatory.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"600a172716212679efbe5fe284a0106d3e223d06f7e133c9b6857801c38fb6ff","body_hash":"6c89b9218ba72049cc9394127145449730e289ac6719e2e16dba8049c92e8f94","strict":true,"agent_id":"codex","agent_model":"copilot/gpt-5.6-luna","engine_versions":{"codex":"0.159.3"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"600a172716212679efbe5fe284a0106d3e223d06f7e133c9b6857801c38fb6ff","body_hash":"adecd8c7dc1338f369716cd42016513041baba1d4b25ef567b4fb60fae68f4de","strict":true,"agent_id":"codex","agent_model":"copilot/gpt-5.6-luna","engine_versions":{"codex":"0.159.3"}} # gh-aw-manifest: {"version":1,"secrets":["COPILOT_GITHUB_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_discussion","get_discussion_comments","get_file_contents","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_discussion_categories","list_discussions","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"mcpscripts","tools":["github-discussion-query","github-issue-query","github-pr-query"]},{"name":"safeoutputs","tools":["close_discussion","create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-repo-chronicle.lock.yml b/.github/workflows/daily-repo-chronicle.lock.yml index 76a39c9436b..12aee757ce3 100644 --- a/.github/workflows/daily-repo-chronicle.lock.yml +++ b/.github/workflows/daily-repo-chronicle.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"db5f682eb5f8468bbcf87c421e53f230d4a017638732b0810152c85d339d335c","body_hash":"84d8dd21786233f82d0913f4e09e4106d66e50c140e4c105ebc13890c6d4645a","strict":true,"agent_id":"pi","agent_model":"copilot/grok-4.7","engine_versions":{"pi":"1.0.0"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"db5f682eb5f8468bbcf87c421e53f230d4a017638732b0810152c85d339d335c","body_hash":"d858908351e83528b1302a7fc655c2e1469bda53213252a721187aeed5f7d374","strict":true,"agent_id":"pi","agent_model":"copilot/grok-4.7","engine_versions":{"pi":"1.0.0"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/cache/restore","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/cache/save","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"},{"repo":"astral-sh/setup-uv","sha":"1c37ad07a6a961277cf70c0d37d6f313000f5884","version":"v10.3.0"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete","upload_asset"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-report-dispatcher.lock.yml b/.github/workflows/daily-report-dispatcher.lock.yml index c26c5ed0e6c..dcb208f1082 100644 --- a/.github/workflows/daily-report-dispatcher.lock.yml +++ b/.github/workflows/daily-report-dispatcher.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"357e7f164afb59e434f26061bd49336b59ea533c3def52c4474355ef32f9e136","body_hash":"58b018ed837c71cb1a1c9643932c786ba3b2d43ba65b1af6d4e8bf868e64a15e","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"fb8adae32e23895ec4cac14755eb95708f1af7dea138a72192ab5233b2a64dfb","body_hash":"a7c794e2e44c5bca8ac13e16ac2cfa6514c70aa25e12c0b4bafee2fccd5ba21c","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_file_contents","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"safeoutputs","tools":["artifacts_summary","daily_compiler_quality","daily_evals_report","daily_firewall_report","daily_issues_report","daily_observability_report","daily_regulatory","daily_repo_chronicle","daily_secrets_analysis","daily_team_evolution_insights","daily_token_consumption_report","deep_report","dispatch_workflow","missing_data","missing_tool","noop","repo_tree_map","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -25,6 +25,10 @@ # # Admits a bounded discussion-report cohort with daily rotation and weekly report slots, then requests native queue grants # +# Resolved workflow manifest: +# Imports: +# - shared/work-queue-staged-plan.md +# # Secrets used: # - GH_AW_DEFAULT_OTLP_ENDPOINT # - GH_AW_DEFAULT_OTLP_HEADERS @@ -260,7 +264,7 @@ jobs: GH_AW_ACTIONS_DIR: ${{ runner.temp }}/gh-aw/actions GH_AW_PROMPT: ${{ runner.temp }}/gh-aw/aw-prompts/prompt.txt GH_AW_SAFE_OUTPUTS: ${{ runner.temp }}/gh-aw/safeoutputs/outputs.jsonl - GH_AW_PROMPT_CONFIG: "{\"items\":[{\"content_env\":\"GH_AW_PROMPT_CONTENT_0000\"},{\"file\":\"xpia.md\"},{\"file\":\"temp_folder_prompt.md\"},{\"file\":\"markdown.md\"},{\"file\":\"safe_outputs_mcp_transport_prompt.md\"},{\"file\":\"safe_outputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0001\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0002\"},{\"file\":\"mcp_cli_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0003\"},{\"file\":\"github_mcp_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0004\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0005\"}],\"system_item_count\":12}" + GH_AW_PROMPT_CONFIG: "{\"items\":[{\"content_env\":\"GH_AW_PROMPT_CONTENT_0000\"},{\"file\":\"xpia.md\"},{\"file\":\"temp_folder_prompt.md\"},{\"file\":\"markdown.md\"},{\"file\":\"safe_outputs_mcp_transport_prompt.md\"},{\"file\":\"safe_outputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0001\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0002\"},{\"file\":\"mcp_cli_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0003\"},{\"file\":\"github_mcp_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0004\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0005\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0006\"}],\"system_item_count\":12}" GH_AW_EXPR_76DF9333: ${{ github.event.pull_request.number || (fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_type == 'pull_request' && fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_number) }} GH_AW_EXPR_77C1A4D2: ${{ github.event.comment.id || fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').comment_id }} GH_AW_EXPR_7C248226: ${{ github.event.issue.number || (fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_type == 'issue' && fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_number) }} @@ -274,7 +278,8 @@ jobs: GH_AW_PROMPT_CONTENT_0002: "\n" GH_AW_PROMPT_CONTENT_0003: "\nThe following GitHub context information is available for this workflow:\n{{#if github.actor}}\n- **actor**: __GH_AW_GITHUB_ACTOR__\n{{/if}}\n{{#if github.repository}}\n- **repository**: __GH_AW_GITHUB_REPOSITORY__\n{{/if}}\n{{#if github.workspace}}\n- **workspace**: __GH_AW_GITHUB_WORKSPACE__\n{{/if}}\n{{#if github.event.issue.number || (github.aw.context.item_type == 'issue' && github.aw.context.item_number)}}\n- **issue-number**: #__GH_AW_EXPR_7C248226__\n{{/if}}\n{{#if github.event.discussion.number || (github.aw.context.item_type == 'discussion' && github.aw.context.item_number)}}\n- **discussion-number**: #__GH_AW_EXPR_C19C384F__\n{{/if}}\n{{#if github.event.pull_request.number || (github.aw.context.item_type == 'pull_request' && github.aw.context.item_number)}}\n- **pull-request-number**: #__GH_AW_EXPR_76DF9333__\n{{/if}}\n{{#if github.event.comment.id || github.aw.context.comment_id}}\n- **comment-id**: __GH_AW_EXPR_77C1A4D2__\n{{/if}}\n{{#if github.run_id}}\n- **workflow-run-id**: __GH_AW_GITHUB_RUN_ID__\n{{/if}}\n\n\n" GH_AW_PROMPT_CONTENT_0004: "\n" - GH_AW_PROMPT_CONTENT_0005: "{{#runtime-import .github/workflows/daily-report-dispatcher.md}}\n" + GH_AW_PROMPT_CONTENT_0005: "{{#runtime-import .github/workflows/shared/work-queue-staged-plan.md}}\n" + GH_AW_PROMPT_CONTENT_0006: "{{#runtime-import .github/workflows/daily-report-dispatcher.md}}\n" with: script: | const { setupGlobals } = require(process.env.GH_AW_ACTIONS_DIR + '/setup_globals.cjs'); @@ -535,7 +540,7 @@ jobs: - name: Prepare the UTC daily report cohort uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9.0.0 with: - script: "const fs = require(\"node:fs\");\nconst path = require(\"node:path\");\nconst { buildDailyReportPlan } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/daily_report_portfolio.cjs\"));\nconst { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId });\nconst { data: repository } = await github.rest.repos.get(context.repo);\nconst plan = buildDailyReportPlan({\n date: new Date(Date.parse(run.created_at) - 86400000).toISOString().slice(0, 10),\n repository: repository.full_name,\n repositoryId: String(repository.id),\n});\nfs.mkdirSync(\"/tmp/gh-aw/agent\", { recursive: true });\nfs.writeFileSync(\"/tmp/gh-aw/agent/daily-report-plan.json\", JSON.stringify(plan));\ncore.info(`Daily report cohort ${plan.date}: ${plan.selected.join(\", \")}`);" + script: "const fs = require(\"node:fs\");\nconst path = require(\"node:path\");\nconst { buildDailyReportPlan } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/daily_report_portfolio.cjs\"));\nconst { stagePlanIntents } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/work_queue_intents.cjs\"));\nconst { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId });\nconst { data: repository } = await github.rest.repos.get(context.repo);\nconst plan = buildDailyReportPlan({\n date: new Date(Date.parse(run.created_at) - 86400000).toISOString().slice(0, 10),\n repository: repository.full_name,\n repositoryId: String(repository.id),\n});\nfs.mkdirSync(\"/tmp/gh-aw/agent\", { recursive: true });\nfs.writeFileSync(\"/tmp/gh-aw/agent/daily-report-plan.json\", JSON.stringify(plan));\nstagePlanIntents(path.join(process.env.RUNNER_TEMP, \"gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl\"), plan);\ncore.info(`Daily report cohort ${plan.date}: ${plan.selected.join(\", \")}`);" - name: Configure Git credentials env: diff --git a/.github/workflows/daily-report-dispatcher.md b/.github/workflows/daily-report-dispatcher.md index 3c6903acb57..53d8273ee25 100644 --- a/.github/workflows/daily-report-dispatcher.md +++ b/.github/workflows/daily-report-dispatcher.md @@ -4,6 +4,8 @@ description: Admits a bounded discussion-report cohort with daily rotation and w on: schedule: daily around 10:00 if: github.run_attempt == 1 +imports: + - shared/work-queue-staged-plan.md permissions: contents: read actions: read @@ -41,6 +43,7 @@ steps: const fs = require("node:fs"); const path = require("node:path"); const { buildDailyReportPlan } = require(path.join(process.env.RUNNER_TEMP, "gh-aw/actions/daily_report_portfolio.cjs")); + const { stagePlanIntents } = require(path.join(process.env.RUNNER_TEMP, "gh-aw/actions/work_queue_intents.cjs")); const { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId }); const { data: repository } = await github.rest.repos.get(context.repo); const plan = buildDailyReportPlan({ @@ -50,6 +53,7 @@ steps: }); fs.mkdirSync("/tmp/gh-aw/agent", { recursive: true }); fs.writeFileSync("/tmp/gh-aw/agent/daily-report-plan.json", JSON.stringify(plan)); + stagePlanIntents(path.join(process.env.RUNNER_TEMP, "gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl"), plan); core.info(`Daily report cohort ${plan.date}: ${plan.selected.join(", ")}`); timeout-minutes: 15 strict: true @@ -70,10 +74,10 @@ additional candidates or admission identities. 1. Call `work_queue_read` with `{"pool":"daily-reports","limit":32}`. An absent queue is an empty backlog; the first trusted submission atomically publishes Policy and Work. Reads never seed the queue. Surface queue errors explicitly. -2. Call `work_queue_submit` once with `{"nodes": }`. +2. The staged submission contains `{"nodes": }`. Date-keyed graph/node identities make an identical submission idempotent. Do not edit payloads on a retry or replace immutable admitted Work. -3. Call `work_queue_dispatch_next` once with the exact `plan.dispatch`: +3. The staged dispatch request contains the exact `plan.dispatch`: `{"pool":"daily-reports","max_claims":3,"max_dispatches":3}`. Do not select winning Work IDs, workflows or revisions from the snapshot. The trusted scheduler selects the eligible fair prefix against fresh state @@ -92,5 +96,6 @@ reruns cannot admit another cohort. At most three native launches are permitted in its original daily activation; capacity, pauses or uncertain old launches may permit fewer, and older eligible cohorts may run before newly admitted reports. Do not force-release reservations to make a target count. Three launches are not -a guarantee of three successfully published discussions. Use `noop` if there is -no eligible grant; never label a staged intent as a completed report. +a guarantee of three successfully published discussions. Report only the staged +request; never label it as a completed report or infer +that a stale snapshot guarantees no eligible grant. diff --git a/.github/workflows/daily-secrets-analysis.lock.yml b/.github/workflows/daily-secrets-analysis.lock.yml index 1c569631064..a8258d78928 100644 --- a/.github/workflows/daily-secrets-analysis.lock.yml +++ b/.github/workflows/daily-secrets-analysis.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"498509c379c5762c2792bbbf6829f3f5d4f71ba8abd71d6a4f239630b20a0c54","body_hash":"c83c053b1593762a85064f59a60e36a834fdbe27ede7e1a423a1fbb8f9de4c52","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90","copilot-sdk":"1.0.16"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"498509c379c5762c2792bbbf6829f3f5d4f71ba8abd71d6a4f239630b20a0c54","body_hash":"885d7cab80014183fbb0afbb2b83547caf983752485394d2014b61cfdccb1e1b","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90","copilot-sdk":"1.0.16"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/cache/restore","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/cache/save","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-team-evolution-insights.lock.yml b/.github/workflows/daily-team-evolution-insights.lock.yml index 351ad7442c1..7386ce621ad 100644 --- a/.github/workflows/daily-team-evolution-insights.lock.yml +++ b/.github/workflows/daily-team-evolution-insights.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"89e73d3eac95f4e008e10409b19d99d32705f0c7158a11ca8a6b00a307a4a57e","body_hash":"391b154e4ca1a2b0582d4137a684b2aaee7856159a7e495782c68894505ed4ee","agent_id":"goose","agent_model":"copilot/auto","engine_versions":{"goose":"1.53.0"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"89e73d3eac95f4e008e10409b19d99d32705f0c7158a11ca8a6b00a307a4a57e","body_hash":"bb8f20c79374a8994950dcb72956a1a2a809e3fa06d85832ec93a5b05d64a5f8","agent_id":"goose","agent_model":"copilot/auto","engine_versions":{"goose":"1.53.0"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_discussion","get_discussion_comments","get_file_contents","get_latest_release","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_discussion_categories","list_discussions","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/daily-token-consumption-report.lock.yml b/.github/workflows/daily-token-consumption-report.lock.yml index 946cc00e5bd..50c0628a65d 100644 --- a/.github/workflows/daily-token-consumption-report.lock.yml +++ b/.github/workflows/daily-token-consumption-report.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"bfef140f5cc8edc1d130bec1194bb035dbadc3e93e3052a49b3718f1756c1065","body_hash":"7c3645510cd4c6396804335100a901caf72de6e5df2eba722c1be30ab363ef5f","strict":true,"agent_id":"goose","agent_model":"copilot/claude-sonnet-5","engine_versions":{"goose":"1.53.0"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"bfef140f5cc8edc1d130bec1194bb035dbadc3e93e3052a49b3718f1756c1065","body_hash":"cdcd8a26b395200ee8b1b94ebeada1043c8dc466a40992d1b53cb2aa4301cc14","strict":true,"agent_id":"goose","agent_model":"copilot/claude-sonnet-5","engine_versions":{"goose":"1.53.0"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN","GRAFANA_SERVICE_ACCOUNT_TOKEN","GRAFANA_URL","SENTRY_ACCESS_TOKEN","SENTRY_OPENAI_API_KEY"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"},{"image":"grafana/mcp-grafana:1.1.0-alpine","digest":"sha256:e0eb29cdf8effbbebf115ea99a5f654a44681dfd293661b0991498d651ca6cb4","pinned_image":"grafana/mcp-grafana:1.1.0-alpine@sha256:e0eb29cdf8effbbebf115ea99a5f654a44681dfd293661b0991498d651ca6cb4"},{"image":"node:lts-alpine","digest":"sha256:ebfe2f90462722a7a4de65e91990e97fe0d401c70e0e762c5b53302f905ec1c1","pinned_image":"node:lts-alpine@sha256:ebfe2f90462722a7a4de65e91990e97fe0d401c70e0e762c5b53302f905ec1c1"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_file_contents","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"grafana","tools":["get_datasource","list_datasources","tempo_docs-traceql","tempo_get-attribute-names","tempo_get-attribute-values","tempo_get-trace","tempo_traceql-search"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"sentry","tools":["analyze_issue_with_seer","find_dsns","find_organizations","find_projects","find_releases","find_teams","get_doc","get_event_attachment","get_issue_details","get_trace_details","list_events","list_issue_events","search_docs","search_events","search_issues","whoami"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/deep-report.lock.yml b/.github/workflows/deep-report.lock.yml index 456e360c87e..418eaf96396 100644 --- a/.github/workflows/deep-report.lock.yml +++ b/.github/workflows/deep-report.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"5207b4165009cc88e43e627350a69e491800ec8a389de34ba53483281de4484e","body_hash":"00cb52fd84b020c699ef6ffd70ec28f490b1cd6dd29917d7c86ed471aba75164","strict":true,"agent_id":"claude","engine_versions":{"claude":"2.1.288"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"5207b4165009cc88e43e627350a69e491800ec8a389de34ba53483281de4484e","body_hash":"d3c1091ab9e377c26dd6de8a89190ea662addaf4c7b5099942511cd5eb010b6d","strict":true,"agent_id":"claude","engine_versions":{"claude":"2.1.288"}} # gh-aw-manifest: {"version":1,"secrets":["ANTHROPIC_API_KEY","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/cache/restore","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/cache/save","sha":"55cc8345863c7cc4c66a329aec7e433d2d1c52a9","version":"v6.1.0"},{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-go","sha":"b7ad1dad31e06c5925ef5d2fc7ad053ef454303e","version":"v7.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"},{"repo":"docker/build-push-action","sha":"c3c9e263c25d99ce0380d002d59b67737d91b0dc","version":"v7.4.0"},{"repo":"docker/setup-buildx-action","sha":"f87e5991a6d7451dcb8d9637bfbc97413f497069","version":"v4.4.1"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"},{"image":"node:lts-alpine","digest":"sha256:ebfe2f90462722a7a4de65e91990e97fe0d401c70e0e762c5b53302f905ec1c1","pinned_image":"node:lts-alpine@sha256:ebfe2f90462722a7a4de65e91990e97fe0d401c70e0e762c5b53302f905ec1c1"}],"mcp_servers":[{"name":"agentdb","tools":["*"]},{"name":"agenticworkflows","tools":["*"]},{"name":"github","tools":["actions_get","actions_list","get_commit","get_discussion","get_discussion_comments","get_file_contents","get_job_logs","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_discussion_categories","list_discussions","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"mcpscripts","tools":["list_label","list_workflows"]},{"name":"safeoutputs","tools":["add_comment","create_discussion","create_issue","missing_data","missing_tool","noop","report_incomplete","upload_artifact"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -183,7 +183,7 @@ jobs: GH_AW_EXPERIMENT_SPEC: '{"output_format":{"variants":["full_briefing","executive_brief","annotated_brief","ste"],"description":"Tests whether report verbosity, structure, or Simplified Technical English (STE) phrasing affect token cost and discussion engagement","hypothesis":"H0: no change in discussion engagement or token cost. H1: executive_brief reduces token usage by ≥20% without reducing engagement; annotated_brief improves actionability; ste improves clarity while reducing token usage.","metric":"token_count","secondary_metrics":["discussion_reactions","discussion_replies","output_char_length","run_duration_ms","eval:output_format_goal_met"],"guardrail_metrics":[{"name":"empty_output_rate","threshold":"==0"},{"name":"issue_creation_success_rate","threshold":"\u003e=0.8"}],"min_samples":15,"weight":[25,25,25,25],"start_date":"2026-05-06","analysis_type":"mann_whitney","tags":["output-format","token-cost","engagement","daily"]}}' GH_AW_EXPERIMENT_STATE_FILE: /tmp/gh-aw/experiments/state.jsonl GH_AW_EXPERIMENT_STATE_DIR: /tmp/gh-aw/experiments - GH_AW_HARNESS_VERSION: 5207b4165009cc88e43e627350a69e491800ec8a389de34ba53483281de4484e:00cb52fd84b020c699ef6ffd70ec28f490b1cd6dd29917d7c86ed471aba75164 + GH_AW_HARNESS_VERSION: 5207b4165009cc88e43e627350a69e491800ec8a389de34ba53483281de4484e:d3c1091ab9e377c26dd6de8a89190ea662addaf4c7b5099942511cd5eb010b6d with: script: | const path = require('path'); diff --git a/.github/workflows/engine-conformance-aider.lock.yml b/.github/workflows/engine-conformance-aider.lock.yml index 9fd05aed4c3..00efeb181be 100644 --- a/.github/workflows/engine-conformance-aider.lock.yml +++ b/.github/workflows/engine-conformance-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"a0d366a67887bf0a2a42b5e40f67a3010d15b5825a4a16ba86957e4cc31e4af7","body_hash":"07595cb78705e3076f05c86c91a3ac8249cbe4915b41a419acd31b5ec956ca36","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"8860d1d9147dd1e2dd3b6f2b4500424b3863e41b08c116943285b3db8eb677a8","body_hash":"07595cb78705e3076f05c86c91a3ac8249cbe4915b41a419acd31b5ec956ca36","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"mcpscripts","tools":["conformance-challenge"]},{"name":"safeoutputs","tools":["create_issue","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"disabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1199,7 +1199,7 @@ jobs: "pi.message_snapshot", ]); const isInterpreted = entry => interpretedTypes.has(entry.type) || - entry.type.startsWith("subagent."); + entry.type.startsWith("subagent.") || entry.type.startsWith("otel."); const logEntries = (parseLogEntries(logContent) || []).filter( entry => isSessionEvent(entry) && ( entry.data.sourceEngine === "aider" || diff --git a/.github/workflows/engine-conformance-dispatcher.lock.yml b/.github/workflows/engine-conformance-dispatcher.lock.yml index 8f73b6cee60..ba057b0aa7f 100644 --- a/.github/workflows/engine-conformance-dispatcher.lock.yml +++ b/.github/workflows/engine-conformance-dispatcher.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"2fcfbffd347de6548f31205932355ff8cef31b45434eb8ec7ff4c07a9cd3c83a","body_hash":"06b4beba3e1f974cf5140678ecff7ada21c73c1384c9c148a9e6a2052fcc88b6","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"c2f4b3c21296e1c994d15ab850bf403bf23fdf43c808076d8437bef0ff3419df","body_hash":"0abe0595d5a1e573f4a8a6d0b3121c9497d05b1ea5588aabbd81b523040f3464","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_file_contents","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"safeoutputs","tools":["dispatch_workflow","engine_conformance_agy","engine_conformance_aider","engine_conformance_claude","engine_conformance_codex","engine_conformance_copilot","engine_conformance_crush","engine_conformance_cursor","engine_conformance_deepseek_harness","engine_conformance_gemini","engine_conformance_goose","engine_conformance_kiro","engine_conformance_opencode","engine_conformance_pi","engine_conformance_pydantic_ai","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -27,6 +27,10 @@ # # Intent: Detect engine configuration regressions with host-verified conformance checks across the supported and sample engine fleet. # +# Resolved workflow manifest: +# Imports: +# - shared/work-queue-staged-plan.md +# # Secrets used: # - GH_AW_DEFAULT_OTLP_ENDPOINT # - GH_AW_DEFAULT_OTLP_HEADERS @@ -262,7 +266,7 @@ jobs: GH_AW_ACTIONS_DIR: ${{ runner.temp }}/gh-aw/actions GH_AW_PROMPT: ${{ runner.temp }}/gh-aw/aw-prompts/prompt.txt GH_AW_SAFE_OUTPUTS: ${{ runner.temp }}/gh-aw/safeoutputs/outputs.jsonl - GH_AW_PROMPT_CONFIG: "{\"items\":[{\"content_env\":\"GH_AW_PROMPT_CONTENT_0000\"},{\"file\":\"xpia.md\"},{\"file\":\"temp_folder_prompt.md\"},{\"file\":\"markdown.md\"},{\"file\":\"safe_outputs_mcp_transport_prompt.md\"},{\"file\":\"safe_outputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0001\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0002\"},{\"file\":\"mcp_cli_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0003\"},{\"file\":\"github_mcp_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0004\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0005\"}],\"system_item_count\":12}" + GH_AW_PROMPT_CONFIG: "{\"items\":[{\"content_env\":\"GH_AW_PROMPT_CONTENT_0000\"},{\"file\":\"xpia.md\"},{\"file\":\"temp_folder_prompt.md\"},{\"file\":\"markdown.md\"},{\"file\":\"safe_outputs_mcp_transport_prompt.md\"},{\"file\":\"safe_outputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0001\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0002\"},{\"file\":\"mcp_cli_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0003\"},{\"file\":\"github_mcp_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0004\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0005\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0006\"}],\"system_item_count\":12}" GH_AW_EXPR_76DF9333: ${{ github.event.pull_request.number || (fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_type == 'pull_request' && fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_number) }} GH_AW_EXPR_77C1A4D2: ${{ github.event.comment.id || fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').comment_id }} GH_AW_EXPR_7C248226: ${{ github.event.issue.number || (fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_type == 'issue' && fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_number) }} @@ -276,7 +280,8 @@ jobs: GH_AW_PROMPT_CONTENT_0002: "\n" GH_AW_PROMPT_CONTENT_0003: "\nThe following GitHub context information is available for this workflow:\n{{#if github.actor}}\n- **actor**: __GH_AW_GITHUB_ACTOR__\n{{/if}}\n{{#if github.repository}}\n- **repository**: __GH_AW_GITHUB_REPOSITORY__\n{{/if}}\n{{#if github.workspace}}\n- **workspace**: __GH_AW_GITHUB_WORKSPACE__\n{{/if}}\n{{#if github.event.issue.number || (github.aw.context.item_type == 'issue' && github.aw.context.item_number)}}\n- **issue-number**: #__GH_AW_EXPR_7C248226__\n{{/if}}\n{{#if github.event.discussion.number || (github.aw.context.item_type == 'discussion' && github.aw.context.item_number)}}\n- **discussion-number**: #__GH_AW_EXPR_C19C384F__\n{{/if}}\n{{#if github.event.pull_request.number || (github.aw.context.item_type == 'pull_request' && github.aw.context.item_number)}}\n- **pull-request-number**: #__GH_AW_EXPR_76DF9333__\n{{/if}}\n{{#if github.event.comment.id || github.aw.context.comment_id}}\n- **comment-id**: __GH_AW_EXPR_77C1A4D2__\n{{/if}}\n{{#if github.run_id}}\n- **workflow-run-id**: __GH_AW_GITHUB_RUN_ID__\n{{/if}}\n\n\n" GH_AW_PROMPT_CONTENT_0004: "\n" - GH_AW_PROMPT_CONTENT_0005: "{{#runtime-import .github/workflows/engine-conformance-dispatcher.md}}\n" + GH_AW_PROMPT_CONTENT_0005: "{{#runtime-import .github/workflows/shared/work-queue-staged-plan.md}}\n" + GH_AW_PROMPT_CONTENT_0006: "{{#runtime-import .github/workflows/engine-conformance-dispatcher.md}}\n" with: script: | const { setupGlobals } = require(process.env.GH_AW_ACTIONS_DIR + '/setup_globals.cjs'); @@ -537,7 +542,7 @@ jobs: - name: Prepare engine conformance cohort uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9.0.0 with: - script: "const fs = require(\"node:fs\");\nconst path = require(\"node:path\");\nconst { buildEngineConformancePlan, ENGINES } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/engine_conformance_portfolio.cjs\"));\nconst { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId });\nconst { data: repository } = await github.rest.repos.get(context.repo);\nconst date = new Date(run.created_at).toISOString().slice(0, 10);\nconst until = new Date(Date.parse(date + \"T00:00:00Z\") - 7 * 86400000).toISOString();\nconst { data: older } = await github.rest.repos.listCommits({ ...context.repo, sha: repository.default_branch, until, per_page: 1 });\nlet changedPaths = [];\nif (older.length) {\n const { data: comparison } = await github.rest.repos.compareCommits({\n ...context.repo, base: older[0].sha, head: repository.default_branch,\n });\n changedPaths = comparison.total_commits > 250 || (comparison.files || []).length >= 300\n ? ENGINES.map(engine => `.github/workflows/engine-conformance-${engine}.md`)\n : (comparison.files || []).map(file => file.filename);\n}\nconst plan = buildEngineConformancePlan({\n date, repository: repository.full_name, repositoryId: String(repository.id), changedPaths,\n});\nfs.mkdirSync(\"/tmp/gh-aw/agent\", { recursive: true });\nfs.writeFileSync(\"/tmp/gh-aw/agent/engine-conformance-plan.json\", JSON.stringify(plan));\ncore.info(`Engine conformance cohort ${date}: ${plan.selected.join(\", \")}`);" + script: "const fs = require(\"node:fs\");\nconst path = require(\"node:path\");\nconst { buildEngineConformancePlan, ENGINES } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/engine_conformance_portfolio.cjs\"));\nconst { stagePlanIntents } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/work_queue_intents.cjs\"));\nconst { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId });\nconst { data: repository } = await github.rest.repos.get(context.repo);\nconst date = new Date(run.created_at).toISOString().slice(0, 10);\nconst until = new Date(Date.parse(date + \"T00:00:00Z\") - 7 * 86400000).toISOString();\nconst { data: older } = await github.rest.repos.listCommits({ ...context.repo, sha: repository.default_branch, until, per_page: 1 });\nlet changedPaths = [];\nif (older.length) {\n const { data: comparison } = await github.rest.repos.compareCommits({\n ...context.repo, base: older[0].sha, head: repository.default_branch,\n });\n changedPaths = comparison.total_commits > 250 || (comparison.files || []).length >= 300\n ? ENGINES.map(engine => `.github/workflows/engine-conformance-${engine}.md`)\n : (comparison.files || []).map(file => file.filename);\n}\nconst plan = buildEngineConformancePlan({\n date, repository: repository.full_name, repositoryId: String(repository.id), changedPaths,\n});\nfs.mkdirSync(\"/tmp/gh-aw/agent\", { recursive: true });\nfs.writeFileSync(\"/tmp/gh-aw/agent/engine-conformance-plan.json\", JSON.stringify(plan));\nstagePlanIntents(path.join(process.env.RUNNER_TEMP, \"gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl\"), plan);\ncore.info(`Engine conformance cohort ${date}: ${plan.selected.join(\", \")}`);" - name: Configure Git credentials env: diff --git a/.github/workflows/engine-conformance-dispatcher.md b/.github/workflows/engine-conformance-dispatcher.md index 1fdd12c02f5..a5a6af94bc3 100644 --- a/.github/workflows/engine-conformance-dispatcher.md +++ b/.github/workflows/engine-conformance-dispatcher.md @@ -6,6 +6,8 @@ on: schedule: daily around 09:00 workflow_dispatch: if: github.run_attempt == 1 +imports: + - shared/work-queue-staged-plan.md permissions: contents: read actions: read @@ -45,6 +47,7 @@ steps: const fs = require("node:fs"); const path = require("node:path"); const { buildEngineConformancePlan, ENGINES } = require(path.join(process.env.RUNNER_TEMP, "gh-aw/actions/engine_conformance_portfolio.cjs")); + const { stagePlanIntents } = require(path.join(process.env.RUNNER_TEMP, "gh-aw/actions/work_queue_intents.cjs")); const { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId }); const { data: repository } = await github.rest.repos.get(context.repo); const date = new Date(run.created_at).toISOString().slice(0, 10); @@ -64,6 +67,7 @@ steps: }); fs.mkdirSync("/tmp/gh-aw/agent", { recursive: true }); fs.writeFileSync("/tmp/gh-aw/agent/engine-conformance-plan.json", JSON.stringify(plan)); + stagePlanIntents(path.join(process.env.RUNNER_TEMP, "gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl"), plan); core.info(`Engine conformance cohort ${date}: ${plan.selected.join(", ")}`); timeout-minutes: 15 strict: true @@ -83,9 +87,9 @@ backlog; the first trusted submission atomically installs Policy and Work. An existing policyless ledger is a failure. Surface tool failures instead of claiming an empty queue, and never dispatch ordinary workflows. -Call `work_queue_submit` once with `{"nodes": }`. Date-keyed Work -identities make a same-day repeat idempotent. Then call -`work_queue_dispatch_next` once with the exact `plan.dispatch`: +The staged submission contains `{"nodes": }`. Date-keyed Work +identities make a same-day repeat idempotent. The staged +dispatch request contains the exact `plan.dispatch`: `{"pool":"engine-conformance","max_claims":3,"max_dispatches":3}`. Use only the advertised work-queue MCP tools or their CLI wrappers. Do not choose the winning Work, worker, revision, or target: the installed Policy does that. @@ -96,4 +100,5 @@ in `.github/workflows/aw.json` under `work_queue`. AW handles authorization, approved worker routes and actual native-run binding; no producer enrollment, worker-principal configuration or administrator seeding is required. The three-launch cap may produce fewer launches if capacity is unavailable. -Use `noop` only when there is no eligible grant, not when admission fails. +Report only the staged request; do not infer a grant or empty live queue from +the activation snapshot. diff --git a/.github/workflows/eslint-factory-dispatcher.lock.yml b/.github/workflows/eslint-factory-dispatcher.lock.yml index 980759c17ff..b200be68c89 100644 --- a/.github/workflows/eslint-factory-dispatcher.lock.yml +++ b/.github/workflows/eslint-factory-dispatcher.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"057fd8fa7ae9c94a50ff871759e8210710cd1f0deee2eb847d660577784fceea","body_hash":"e0d92be508dc468dd078dcd13e6f3f02e4735500c207c13d35b9673914774dd3","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"2efb780468703a6b32d5a0cc477977f035a8696d5c341df7f414c36fa23652a4","body_hash":"13710fcff306ed8524ef3882425ec0ef7d6210f620e4a1b64f3ccce8d14fc3a2","strict":true,"agent_id":"copilot","engine_versions":{"copilot":"1.0.90"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_file_contents","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"safeoutputs","tools":["dispatch_workflow","eslint_miner","eslint_monster","eslint_refiner","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -25,6 +25,10 @@ # # Admits daily ESLint factory tasks and dispatches queued work to the corresponding worker # +# Resolved workflow manifest: +# Imports: +# - shared/work-queue-staged-plan.md +# # Secrets used: # - GH_AW_DEFAULT_OTLP_ENDPOINT # - GH_AW_DEFAULT_OTLP_HEADERS @@ -259,7 +263,7 @@ jobs: GH_AW_ACTIONS_DIR: ${{ runner.temp }}/gh-aw/actions GH_AW_PROMPT: ${{ runner.temp }}/gh-aw/aw-prompts/prompt.txt GH_AW_SAFE_OUTPUTS: ${{ runner.temp }}/gh-aw/safeoutputs/outputs.jsonl - GH_AW_PROMPT_CONFIG: "{\"items\":[{\"content_env\":\"GH_AW_PROMPT_CONTENT_0000\"},{\"file\":\"xpia.md\"},{\"file\":\"temp_folder_prompt.md\"},{\"file\":\"markdown.md\"},{\"file\":\"safe_outputs_mcp_transport_prompt.md\"},{\"file\":\"safe_outputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0001\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0002\"},{\"file\":\"mcp_cli_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0003\"},{\"file\":\"github_mcp_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0004\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0005\"}],\"system_item_count\":12}" + GH_AW_PROMPT_CONFIG: "{\"items\":[{\"content_env\":\"GH_AW_PROMPT_CONTENT_0000\"},{\"file\":\"xpia.md\"},{\"file\":\"temp_folder_prompt.md\"},{\"file\":\"markdown.md\"},{\"file\":\"safe_outputs_mcp_transport_prompt.md\"},{\"file\":\"safe_outputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0001\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0002\"},{\"file\":\"mcp_cli_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0003\"},{\"file\":\"github_mcp_tools_with_safeoutputs_prompt.md\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0004\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0005\"},{\"content_env\":\"GH_AW_PROMPT_CONTENT_0006\"}],\"system_item_count\":12}" GH_AW_EXPR_76DF9333: ${{ github.event.pull_request.number || (fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_type == 'pull_request' && fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_number) }} GH_AW_EXPR_77C1A4D2: ${{ github.event.comment.id || fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').comment_id }} GH_AW_EXPR_7C248226: ${{ github.event.issue.number || (fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_type == 'issue' && fromJSON(steps.generate_aw_info.outputs.aw_context || '{}').item_number) }} @@ -273,7 +277,8 @@ jobs: GH_AW_PROMPT_CONTENT_0002: "\n" GH_AW_PROMPT_CONTENT_0003: "\nThe following GitHub context information is available for this workflow:\n{{#if github.actor}}\n- **actor**: __GH_AW_GITHUB_ACTOR__\n{{/if}}\n{{#if github.repository}}\n- **repository**: __GH_AW_GITHUB_REPOSITORY__\n{{/if}}\n{{#if github.workspace}}\n- **workspace**: __GH_AW_GITHUB_WORKSPACE__\n{{/if}}\n{{#if github.event.issue.number || (github.aw.context.item_type == 'issue' && github.aw.context.item_number)}}\n- **issue-number**: #__GH_AW_EXPR_7C248226__\n{{/if}}\n{{#if github.event.discussion.number || (github.aw.context.item_type == 'discussion' && github.aw.context.item_number)}}\n- **discussion-number**: #__GH_AW_EXPR_C19C384F__\n{{/if}}\n{{#if github.event.pull_request.number || (github.aw.context.item_type == 'pull_request' && github.aw.context.item_number)}}\n- **pull-request-number**: #__GH_AW_EXPR_76DF9333__\n{{/if}}\n{{#if github.event.comment.id || github.aw.context.comment_id}}\n- **comment-id**: __GH_AW_EXPR_77C1A4D2__\n{{/if}}\n{{#if github.run_id}}\n- **workflow-run-id**: __GH_AW_GITHUB_RUN_ID__\n{{/if}}\n\n\n" GH_AW_PROMPT_CONTENT_0004: "\n" - GH_AW_PROMPT_CONTENT_0005: "{{#runtime-import .github/workflows/eslint-factory-dispatcher.md}}\n" + GH_AW_PROMPT_CONTENT_0005: "{{#runtime-import .github/workflows/shared/work-queue-staged-plan.md}}\n" + GH_AW_PROMPT_CONTENT_0006: "{{#runtime-import .github/workflows/eslint-factory-dispatcher.md}}\n" with: script: | const { setupGlobals } = require(process.env.GH_AW_ACTIONS_DIR + '/setup_globals.cjs'); @@ -534,7 +539,7 @@ jobs: - name: Prepare the UTC ESLint factory cohort uses: actions/github-script@3a2844b7e9c422d3c10d287c895573f7108da1b3 # v9.0.0 with: - script: "const fs = require(\"node:fs\");\nconst path = require(\"node:path\");\nconst { buildESLintFactoryPlan } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/eslint_factory_portfolio.cjs\"));\nconst { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId });\nconst { data: repository } = await github.rest.repos.get(context.repo);\nconst plan = buildESLintFactoryPlan({\n date: new Date(run.created_at).toISOString().slice(0, 10),\n repository: repository.full_name,\n repositoryId: String(repository.id),\n});\nfs.mkdirSync(\"/tmp/gh-aw/agent\", { recursive: true });\nfs.writeFileSync(\"/tmp/gh-aw/agent/eslint-factory-plan.json\", JSON.stringify(plan));\ncore.info(`ESLint factory cohort ${plan.date}: ${plan.nodes.length} tasks`);" + script: "const fs = require(\"node:fs\");\nconst path = require(\"node:path\");\nconst { buildESLintFactoryPlan } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/eslint_factory_portfolio.cjs\"));\nconst { stagePlanIntents } = require(path.join(process.env.RUNNER_TEMP, \"gh-aw/actions/work_queue_intents.cjs\"));\nconst { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId });\nconst { data: repository } = await github.rest.repos.get(context.repo);\nconst plan = buildESLintFactoryPlan({\n date: new Date(run.created_at).toISOString().slice(0, 10),\n repository: repository.full_name,\n repositoryId: String(repository.id),\n});\nfs.mkdirSync(\"/tmp/gh-aw/agent\", { recursive: true });\nfs.writeFileSync(\"/tmp/gh-aw/agent/eslint-factory-plan.json\", JSON.stringify(plan));\nstagePlanIntents(path.join(process.env.RUNNER_TEMP, \"gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl\"), plan);\ncore.info(`ESLint factory cohort ${plan.date}: ${plan.nodes.length} tasks`);" - name: Configure Git credentials env: @@ -604,8 +609,9 @@ jobs: env: GH_AW_FILE_ROOT: "${{ runner.temp }}/gh-aw" GH_AW_FILE_CONFIG: "{\"files\":[{\"path\":\"safeoutputs/config.json\",\"content_env\":\"GH_AW_SAFE_OUTPUTS_CONFIG\"}]}" - GH_AW_SAFE_OUTPUTS_CONFIG: "{\"create_report_incomplete_issue\":{},\"dispatch_workflow\":{\"allowed_refs\":[\"refs/heads/${{ github.event.repository.default_branch }}\"],\"aw_context_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"github-token\":\"${GH_AW_SECRET_GH_AW_GITHUB_TOKEN}\",\"max\":3,\"target-ref\":\"${{ github.event.repository.default_branch }}\",\"work_queue_dispatch_credential\":{\"kind\":\"authenticated\"},\"work_queue_enabled\":true,\"work_queue_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"workflow_files\":{\"eslint-miner\":\".lock.yml\",\"eslint-monster\":\".lock.yml\",\"eslint-refiner\":\".lock.yml\"},\"workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"]},\"missing_data\":{},\"missing_tool\":{},\"noop\":{\"max\":2,\"report-as-issue\":\"true\"},\"report_incomplete\":{}}" - GH_AW_SECRET_GH_AW_GITHUB_TOKEN: ${{ secrets.GH_AW_GITHUB_TOKEN }} + GH_AW_SAFE_OUTPUTS_CONFIG: "{\"create_report_incomplete_issue\":{},\"dispatch_workflow\":{\"allowed_refs\":[\"refs/heads/${{ github.event.repository.default_branch }}\"],\"aw_context_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"github-token\":\"${GH_AW_SECRET_GITHUB_TOKEN}\",\"max\":3,\"target-ref\":\"${{ github.event.repository.default_branch }}\",\"work_queue_dispatch_credential\":{\"kind\":\"${GH_AW_SECRET_GH_AW_GITHUB_TOKEN}\"},\"work_queue_enabled\":true,\"work_queue_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"workflow_files\":{\"eslint-miner\":\".lock.yml\",\"eslint-monster\":\".lock.yml\",\"eslint-refiner\":\".lock.yml\"},\"workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"]},\"missing_data\":{},\"missing_tool\":{},\"noop\":{\"max\":2,\"report-as-issue\":\"true\"},\"report_incomplete\":{}}" + GH_AW_SECRET_GH_AW_GITHUB_TOKEN: ${{ secrets.GH_AW_GITHUB_TOKEN != '' && 'authenticated' || 'github_token' }} + GH_AW_SECRET_GITHUB_TOKEN: ${{ secrets.GH_AW_GITHUB_TOKEN || secrets.GITHUB_TOKEN }} with: script: | const path = require('path'); @@ -1833,7 +1839,7 @@ jobs: GH_AW_WORK_QUEUE_POLICY_2: "\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"daily-token-consumption-report\":{\"logical_contract\":\"e429ffea7f7401258a738c69221929dacd1531d017b651eef906a28641a67e2f\",\"workflow\":\".github/workflows/daily-token-consumption-report.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"deep-report\":{\"logical_contract\":\"099f49b1f233e2c5ebfe89e8fb87697affeb622b76156d375591191c6b28872c\",\"workflow\":\".github/workflows/deep-report.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-agy\":{\"logical_contract\":\"7f5cb738b2b7c47ff9f918062c4de9159b33421bc8321c5d99b688b7e3ca2eb8\",\"workflow\":\".github/workflows/engine-conformance-agy.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-aider\":{\"logical_contract\":\"3822eab0a946e83d62d52e55f17e889ee4db367b40a63e53978b52963f89cbf2\",\"workflow\":\".github/workflows/engine-conformance-aider.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-claude\":{\"logical_contract\":\"baad6e27d6d5b3c826d5aa25d6ba2f3cf8b5818bcafb8e420a137a50e7dffe0e\",\"workflow\":\".github/workflows/engine-conformance-claude.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-codex\":{\"logical_contract\":\"baad6e27d6d5b3c826d5aa25d6ba2f3cf8b5818bcafb8e420a137a50e7dffe0e\",\"workflow\":\".github/workflows/engine-conformance-codex.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-copilot\":{\"logical_contract\":\"22f605b30efc2472f3b2f346e24b54dc7b4bbccb18fa930ebeeecc4b922ecab3\",\"workflow\":\".github/workflows/engine-conformance-copilot.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-crush\":{\"logical_contract\":\"f6c16dcd5e57ca69b78091e6062bfa4e6129a60d47e21ade47668b71e02feba8\",\"workflow\":\".github/workflows/engine-conformance-crush.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-cursor\":{\"logical_contract\":\"14639a000869e40bfa9e9cb312ab60e13cc3039f2df1297776e21487769cb127\",\"workflow\":\".github/workflows/engine-conformance-cursor.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-deepseek-harness\":{\"logical_contract\":\"3822eab0a946e83d62d52e55f17e889ee4db367b40a63e53978b52963f89cbf2\",\"workflow\":\".github/workflows/engine-conformance-deepseek-harness.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-gemini\":{\"logical_contract\":\"baad6e27d6d5b3c826d5aa25d6ba2f3cf8b5818bcafb8e420a137a50e7dffe0e\",\"workflow\":\".github/workflows/engine-conformance-gemini.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-goose\":{\"logical_contract\":\"f6c16dcd5e57ca69b78091e6062bfa4e6129a60d47e21ade47668b71e02feba8\",\"workflow\":\".github/workflows/engine-conformance-goose.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-kiro\":{\"logical_contract\":\"14639a000869e40bfa9e9cb312ab60e13cc3039f2df1297776e21487769cb127\",\"workflow\":\".github/workflows/engine-conformance-kiro.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-opencode\":{\"logical_contract\":\"f6c16dcd5e57ca69b78091e6062bfa4e6129a60d47e21ade47668b71e02feba8\",\"workflow\":\".github/workflows/engine-conformance-opencode.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-pi\":{\"logical_contract\":\"22f605b30efc2472f3b2f346e24b54dc7b4bbccb18fa930ebeeecc4b922ecab3\",\"workflow\":\".github/workflows/engine-conformance-pi.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"engine-conformance-pydantic-ai\":{\"logical_contract\":\"f6c16dcd5e57ca69b78091e6062bfa4e6129a60d47e21ade47668b71e02feba8\",\"workflow\":\".github/workflows/engine-conformance-pydantic-ai.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"eslint-miner\":{\"logical_contract\":\"e1ae579a2beb08ebce029363f9f59ec3bb85b84fa066210be66fd41b013b7a9c\",\"workflow\":\".github/workflows/eslint-miner.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"eslint-monster\":{\"logical_contract\":\"ed27c8f7b06c56b27a284332f5674e71e8822fed6fd61603d0ade616be76ecbd\",\"workflow\":\".github/workflows/eslint-monster.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"eslint-refiner\":{\"logical_contract\":\"e25a866c9c9c5518ada0e1e45dffdce7925bad3463b3f47f34a861f534353928\",\"workflow\":\".github/workflows/eslint-refiner.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false},\"repo-tree-map\":{\"logical_contract\":\"07d113d7757ea868f42209419497afe38ef74eacb73f45ea12dae0cfe9c5d9ba\",\"workflow\":\".github/workflows/repo-tree-map.lock.yml\",\"ref\":\"${{ github.sha }}\",\"trust_domain\":\"default\",\"credential_scope\":\"repository\",\"effect_scope\":\"${{ github.repository }}\",\"max_claims\":1,\"share_keys\":false}},\"logical_limit\":3,\"native_limit\":3,\"per_account_limit\":1,\"allowed_repositories\":[\"${{ github.repository }}\"],\"max_observation_age_ms\":60000,\"retry\":{\"max_attempts\":3,\"backoff_ms\":30000},\"reconciliation\":{\"max_attempts\":5,\"deadline_ms\":300000}}},\"limits\":{\"ledger_bytes\":67108864,\"recovery_bytes\":16777216,\"payload_bytes\":16384,\"graph_nodes\":4096,\"predecessors\":64,\"pending_nodes\":30,\"operations\":256,\"assignment_bytes\":49152,\"result_bytes\":4096,\"evidence_bytes\":1024,\"observation_writes\":4096}}" GH_AW_WORK_QUEUE_DISPATCH_BUDGET: "3" GH_AW_WORK_QUEUE_INTENTS: /tmp/gh-aw/work-queue.intents.jsonl - GH_AW_WORK_QUEUE_CONTROL_CONFIG: "{\"allowed_refs\":[\"refs/heads/${{ github.event.repository.default_branch }}\"],\"aw_context_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"github-token\":\"${{ secrets.GH_AW_GITHUB_TOKEN }}\",\"max\":3,\"target-ref\":\"${{ github.event.repository.default_branch }}\",\"work_queue_dispatch_credential\":{\"kind\":\"authenticated\"},\"work_queue_enabled\":true,\"work_queue_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"workflow_files\":{\"eslint-miner\":\".lock.yml\",\"eslint-monster\":\".lock.yml\",\"eslint-refiner\":\".lock.yml\"},\"workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"]}" + GH_AW_WORK_QUEUE_CONTROL_CONFIG: "{\"allowed_refs\":[\"refs/heads/${{ github.event.repository.default_branch }}\"],\"aw_context_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"github-token\":\"${{ secrets.GH_AW_GITHUB_TOKEN || secrets.GITHUB_TOKEN }}\",\"max\":3,\"target-ref\":\"${{ github.event.repository.default_branch }}\",\"work_queue_dispatch_credential\":{\"kind\":\"${{ secrets.GH_AW_GITHUB_TOKEN != '' && 'authenticated' || 'github_token' }}\"},\"work_queue_enabled\":true,\"work_queue_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"workflow_files\":{\"eslint-miner\":\".lock.yml\",\"eslint-monster\":\".lock.yml\",\"eslint-refiner\":\".lock.yml\"},\"workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"]}" with: github-token: ${{ secrets.GH_AW_GITHUB_TOKEN || secrets.GITHUB_TOKEN }} script: | @@ -1863,7 +1869,7 @@ jobs: GH_AW_ALLOWED_DOMAINS: "api.snapcraft.io,archive.ubuntu.com,azure.archive.ubuntu.com,crl.geotrust.com,crl.globalsign.com,crl.identrust.com,crl.sectigo.com,crl.thawte.com,crl.usertrust.com,crl.verisign.com,crl3.digicert.com,crl4.digicert.com,crls.ssl.com,json-schema.org,json.schemastore.org,keyserver.ubuntu.com,ocsp.digicert.com,ocsp.geotrust.com,ocsp.globalsign.com,ocsp.identrust.com,ocsp.sectigo.com,ocsp.ssl.com,ocsp.thawte.com,ocsp.usertrust.com,ocsp.verisign.com,packagecloud.io,packages.cloud.google.com,packages.microsoft.com,ppa.launchpad.net,s.symcb.com,s.symcd.com,security.ubuntu.com,ts-crl.ws.symantec.com,ts-ocsp.ws.symantec.com,www.googleapis.com" GITHUB_SERVER_URL: ${{ github.server_url }} GITHUB_API_URL: ${{ github.api_url }} - GH_AW_SAFE_OUTPUTS_HANDLER_CONFIG: "{\"create_report_incomplete_issue\":{},\"dispatch_workflow\":{\"allowed_refs\":[\"refs/heads/${{ github.event.repository.default_branch }}\"],\"aw_context_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"github-token\":\"${{ secrets.GH_AW_GITHUB_TOKEN }}\",\"max\":3,\"target-ref\":\"${{ github.event.repository.default_branch }}\",\"work_queue_dispatch_credential\":{\"kind\":\"authenticated\"},\"work_queue_enabled\":true,\"work_queue_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"workflow_files\":{\"eslint-miner\":\".lock.yml\",\"eslint-monster\":\".lock.yml\",\"eslint-refiner\":\".lock.yml\"},\"workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"]},\"missing_data\":{},\"missing_tool\":{},\"noop\":{\"max\":2,\"report-as-issue\":\"true\"},\"report_incomplete\":{}}" + GH_AW_SAFE_OUTPUTS_HANDLER_CONFIG: "{\"create_report_incomplete_issue\":{},\"dispatch_workflow\":{\"allowed_refs\":[\"refs/heads/${{ github.event.repository.default_branch }}\"],\"aw_context_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"github-token\":\"${{ secrets.GH_AW_GITHUB_TOKEN || secrets.GITHUB_TOKEN }}\",\"max\":3,\"target-ref\":\"${{ github.event.repository.default_branch }}\",\"work_queue_dispatch_credential\":{\"kind\":\"${{ secrets.GH_AW_GITHUB_TOKEN != '' && 'authenticated' || 'github_token' }}\"},\"work_queue_enabled\":true,\"work_queue_workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"],\"workflow_files\":{\"eslint-miner\":\".lock.yml\",\"eslint-monster\":\".lock.yml\",\"eslint-refiner\":\".lock.yml\"},\"workflows\":[\"eslint-miner\",\"eslint-refiner\",\"eslint-monster\"]},\"missing_data\":{},\"missing_tool\":{},\"noop\":{\"max\":2,\"report-as-issue\":\"true\"},\"report_incomplete\":{}}" GH_AW_GITHUB_TOKEN_SOURCE: ${{ secrets.GH_AW_GITHUB_TOKEN != '' && 'pat' || 'github_actions' }} with: github-token: ${{ secrets.GH_AW_GITHUB_TOKEN || secrets.GITHUB_TOKEN }} diff --git a/.github/workflows/eslint-factory-dispatcher.md b/.github/workflows/eslint-factory-dispatcher.md index 20c7c9f7a88..d1f4473c455 100644 --- a/.github/workflows/eslint-factory-dispatcher.md +++ b/.github/workflows/eslint-factory-dispatcher.md @@ -4,6 +4,8 @@ description: Admits daily ESLint factory tasks and dispatches queued work to the on: schedule: daily workflow_dispatch: +imports: + - shared/work-queue-staged-plan.md permissions: contents: read actions: read @@ -17,7 +19,6 @@ tools: safe-outputs: dispatch-workflow: workflows: [eslint-miner, eslint-refiner, eslint-monster] - github-token: ${{ secrets.GH_AW_GITHUB_TOKEN }} target-ref: ${{ github.event.repository.default_branch }} max: 3 noop: @@ -29,6 +30,7 @@ steps: const fs = require("node:fs"); const path = require("node:path"); const { buildESLintFactoryPlan } = require(path.join(process.env.RUNNER_TEMP, "gh-aw/actions/eslint_factory_portfolio.cjs")); + const { stagePlanIntents } = require(path.join(process.env.RUNNER_TEMP, "gh-aw/actions/work_queue_intents.cjs")); const { data: run } = await github.rest.actions.getWorkflowRun({ ...context.repo, run_id: context.runId }); const { data: repository } = await github.rest.repos.get(context.repo); const plan = buildESLintFactoryPlan({ @@ -38,6 +40,7 @@ steps: }); fs.mkdirSync("/tmp/gh-aw/agent", { recursive: true }); fs.writeFileSync("/tmp/gh-aw/agent/eslint-factory-plan.json", JSON.stringify(plan)); + stagePlanIntents(path.join(process.env.RUNNER_TEMP, "gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl"), plan); core.info(`ESLint factory cohort ${plan.date}: ${plan.nodes.length} tasks`); timeout-minutes: 15 strict: true @@ -55,9 +58,8 @@ Read the activation snapshot first with `work_queue_read`, using `"uninitialized"` with a null snapshot SHA means the queue branch does not exist yet. Treat it as an empty backlog; the first trusted producer submission will atomically bootstrap the branch with its compiler-approved Policy and Work. -Do not dispatch until that submission has been admitted. Surface read/tool -errors explicitly; never turn an error or an existing policyless ledger into an -empty-backlog report. +Surface read/tool errors explicitly; never report an existing policyless ledger +as an empty backlog. When `` advertises the wrappers, invoke their subcommands with one JSON argument through the shell tool: @@ -68,22 +70,19 @@ work-queue work_queue_read '{"pool":"default","limit":32}' Use the advertised MCP tools directly when wrappers are not available. -Submit the prepared cohort whether the queue is initialized or absent: -Call `work_queue_submit` once with -`{"nodes": }` before requesting any grants. Date-keyed +The prepared cohort is submitted whether the queue is initialized or absent, +with `{"nodes": }` before requesting any grants. Date-keyed graph/node identities make repeated submissions on the same UTC day idempotent, including manual runs and reruns. Do not change stored task payloads on retries or replace admitted Work. AW authorizes trusted participants; the installed Policy controls scheduling for pool `default`, priority `3`, and accounting key `""`. A failed admission is not permission to bypass scheduling bounds. -With CLI wrappers, use the `work-queue work_queue_submit` subcommand with one -JSON argument containing the exact stored nodes. Submission is also a staged -intent, not proof of durable admission. +Submission is a staged intent, not proof of durable admission. -Then request the trusted scheduler's fair prefix once, using `plan.dispatch`: +The following request is already staged from `plan.dispatch`: -```bash -work-queue work_queue_dispatch_next '{"pool":"default","max_claims":3,"max_dispatches":3}' +```json +{"pool":"default","max_claims":3,"max_dispatches":3} ``` Keep the request within the installed pool policy and this workflow's dispatch @@ -106,10 +105,13 @@ choose or modify Policy. If bootstrap or admission fails, report the failure; do not bypass it with `noop` or ordinary worker dispatch. Scheduling overrides are shared in `.github/workflows/aw.json` under -`work_queue`. AW selects the launch credential and pins declared worker routes +`work_queue`. Trusted `safe-outputs.dispatch-workflow` processing uses the +built-in Actions token with `actions: write`; no custom launch secret is required. +AW pins declared worker routes to the immutable workflow revision; it binds each actual native run to its Claim. The first accepted submission automatically creates the queue with compiled Policy and Work; no administrator seed is required. -Changing scheduling or worker revisions after bootstrap requires a quiescent -queue and an administrator Policy update; editing this proposal alone cannot -replace installed Policy. +Changing economic scheduling after bootstrap requires a quiescent queue and an +administrator Policy update. Compatible worker revisions evolve through trusted +deployment reconciliation; editing this proposal alone cannot replace installed +Policy. diff --git a/.github/workflows/repo-tree-map.lock.yml b/.github/workflows/repo-tree-map.lock.yml index f2bd8f75207..77feea0eed0 100644 --- a/.github/workflows/repo-tree-map.lock.yml +++ b/.github/workflows/repo-tree-map.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"2d4e5b50b4f2dd41a0ca6e39afdb5476c09749e0100ff342e1b025724cf70230","body_hash":"5d638ca19fe8d729712ea0d6eb072c6788e6c86fd92501a29fe8b97281fdb234","strict":true,"agent_id":"pi","agent_model":"copilot/gpt-5.4-mini","engine_versions":{"pi":"1.0.0"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"2d4e5b50b4f2dd41a0ca6e39afdb5476c09749e0100ff342e1b025724cf70230","body_hash":"b694dae5937295a55d4fb4d3889d9516e4394d07829ba6585bbe45fcbf8e9391","strict":true,"agent_id":"pi","agent_model":"copilot/gpt-5.4-mini","engine_versions":{"pi":"1.0.0"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"github","tools":["get_commit","get_file_contents","get_latest_release","get_me","get_pull_request","get_pull_request_comments","get_pull_request_diff","get_pull_request_files","get_pull_request_review_comments","get_pull_request_reviews","get_pull_request_status","get_release_by_tag","get_tag","issue_read","list_branches","list_commits","list_issue_types","list_issues","list_pull_requests","list_releases","list_starred_repositories","list_tags","pull_request_read","search_code","search_issues","search_pull_requests","search_repositories"]},{"name":"safeoutputs","tools":["create_discussion","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # diff --git a/.github/workflows/shared/aider.md b/.github/workflows/shared/aider.md index c5f5f852078..44cb45305f7 100644 --- a/.github/workflows/shared/aider.md +++ b/.github/workflows/shared/aider.md @@ -426,7 +426,7 @@ engine: "pi.message_snapshot", ]); const isInterpreted = entry => interpretedTypes.has(entry.type) || - entry.type.startsWith("subagent."); + entry.type.startsWith("subagent.") || entry.type.startsWith("otel."); const logEntries = (parseLogEntries(logContent) || []).filter( entry => isSessionEvent(entry) && ( entry.data.sourceEngine === "aider" || diff --git a/.github/workflows/shared/daily-report-worker.md b/.github/workflows/shared/daily-report-worker.md index ec0b871de0e..56ab99f9d3a 100644 --- a/.github/workflows/shared/daily-report-worker.md +++ b/.github/workflows/shared/daily-report-worker.md @@ -35,5 +35,6 @@ intent, not proof that the discussion was published: trusted processing verifies delivery before recording Result. If there is no qualifying data, prerequisites are unavailable, or no discussion can be prepared, stage a scoped `noop` or `report_incomplete` and finish with `outcome: "cancelled"` instead. Do not claim -successful reporting without a discussion. The installed one-attempt policy -makes this day's declined report terminal rather than repeatedly consuming slots. +successful reporting without a discussion. A cancelled Claim may be retried +under the installed pool policy; it is not a terminal cancellation of Work until +the configured attempt budget is exhausted. diff --git a/.github/workflows/shared/work-queue-staged-plan.md b/.github/workflows/shared/work-queue-staged-plan.md new file mode 100644 index 00000000000..ebcbf073569 --- /dev/null +++ b/.github/workflows/shared/work-queue-staged-plan.md @@ -0,0 +1,9 @@ +--- +# Shared contract for dispatchers with trusted, pre-staged work-queue plans. +--- + +The trusted preparation step stages exactly one `submit` followed by one bounded +`dispatch_next`. Do not submit, dispatch, edit intent files, reconstruct the +plan, or call ordinary safe outputs such as `noop` or `report_incomplete`. +Read and explain the snapshot only. Trusted processing verifies the exact batch +before admission and launch; an unassigned dispatcher has no worker Claim. diff --git a/.github/workflows/smoke-aider.lock.yml b/.github/workflows/smoke-aider.lock.yml index b4dc38429aa..8182fec1bd8 100644 --- a/.github/workflows/smoke-aider.lock.yml +++ b/.github/workflows/smoke-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"ce776307f4e7e57eb4ba45b87a08d86815564acc90fc9bc8dd874bc0e7fb3637","body_hash":"0974965a5c4bf509abd6408788f035d628d5ab213a7411ade6394d8383edd918","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"d7c776ac47c9d3f3cf76a0feff5caff8ae9cd63971ca586cc0fd9d2bc10896e8","body_hash":"0974965a5c4bf509abd6408788f035d628d5ab213a7411ade6394d8383edd918","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"has_pull_request":true,"mcp_servers":[{"name":"safeoutputs","tools":["add_comment","add_labels","create_issue","missing_data","missing_tool","noop","report_incomplete"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1146,7 +1146,7 @@ jobs: "pi.message_snapshot", ]); const isInterpreted = entry => interpretedTypes.has(entry.type) || - entry.type.startsWith("subagent."); + entry.type.startsWith("subagent.") || entry.type.startsWith("otel."); const logEntries = (parseLogEntries(logContent) || []).filter( entry => isSessionEvent(entry) && ( entry.data.sourceEngine === "aider" || diff --git a/actions/setup/js/daily_report_portfolio.test.cjs b/actions/setup/js/daily_report_portfolio.test.cjs index cfb8217a88d..126f0fe7a54 100644 --- a/actions/setup/js/daily_report_portfolio.test.cjs +++ b/actions/setup/js/daily_report_portfolio.test.cjs @@ -166,6 +166,9 @@ describe("bounded daily and weekly discussion-report portfolio", () => { expect(routes).toEqual(REPORT_PROFILES); expect(dispatcher).toContain("if: github.run_attempt == 1"); expect(dispatcher).toContain("Date.parse(run.created_at) - 86400000"); + expect(dispatcher).toContain("stagePlanIntents("); + expect(dispatcher).toContain("shared/work-queue-staged-plan.md"); + expect(fs.readFileSync(new URL("../../../.github/workflows/shared/work-queue-staged-plan.md", import.meta.url), "utf8")).toContain("Do not submit, dispatch, edit intent files"); expect(dispatcher).not.toMatch(/^\s+workflow_dispatch:/m); expect(dispatcher).toContain(" max: 3"); const lock = fs.readFileSync(new URL("../../../.github/workflows/daily-report-dispatcher.lock.yml", import.meta.url), "utf8"); diff --git a/actions/setup/js/engine_conformance_portfolio.test.cjs b/actions/setup/js/engine_conformance_portfolio.test.cjs index 1edb09f4bc2..34835088d9c 100644 --- a/actions/setup/js/engine_conformance_portfolio.test.cjs +++ b/actions/setup/js/engine_conformance_portfolio.test.cjs @@ -81,6 +81,9 @@ describe("engine conformance queue portfolio", () => { const dispatcher = source("engine-conformance-dispatcher"); expect(dispatcher.match(/^ - engine-conformance-[a-z-]+$/gm)).toHaveLength(ENGINES.length); expect(dispatcher).toContain("if: github.run_attempt == 1"); + expect(dispatcher).toContain("stagePlanIntents("); + expect(dispatcher).toContain("shared/work-queue-staged-plan.md"); + expect(fs.readFileSync(new URL("../../../.github/workflows/shared/work-queue-staged-plan.md", import.meta.url), "utf8")).toContain("Do not submit, dispatch, edit intent files"); expect(compiled("engine-conformance-dispatcher")).toContain("engine_conformance_portfolio.cjs"); for (const engine of ENGINES) { const worker = source(`engine-conformance-${engine}`); diff --git a/actions/setup/js/eslint_factory_portfolio.test.cjs b/actions/setup/js/eslint_factory_portfolio.test.cjs index 8f66915c6b2..3068f8139c1 100644 --- a/actions/setup/js/eslint_factory_portfolio.test.cjs +++ b/actions/setup/js/eslint_factory_portfolio.test.cjs @@ -4,7 +4,7 @@ import fs from "node:fs"; import { randomUUID } from "node:crypto"; import path from "node:path"; import { ESLINT_WORKERS, buildESLintFactoryPlan, buildESLintFactoryPolicy } from "./eslint_factory_portfolio.cjs"; -import { normalizeDispatchParameters, normalizeSubmitParameters } from "./work_queue_intents.cjs"; +import { normalizeDispatchParameters, normalizeSubmitParameters, stagePlanIntents } from "./work_queue_intents.cjs"; import { newState, newRequest, generateRequestOperations, replayTransactions } from "./work_queue_replay.cjs"; import { frozenResourceScope } from "./work_queue_resource_scope.cjs"; import { validateDeliveryContract } from "./work_queue_delivery.cjs"; @@ -117,7 +117,8 @@ describe("ESLint factory producer and dispatcher", () => { expect(source).toContain("buildESLintFactoryPlan"); expect(source).toContain("run.created_at"); expect(source).toContain("cat /tmp/gh-aw/agent/eslint-factory-plan.json"); - expect(source.indexOf("Call `work_queue_submit` once")).toBeLessThan(source.indexOf("request the trusted scheduler")); + expect(source).toContain("stagePlanIntents("); + expect(source).toContain("shared/work-queue-staged-plan.md"); expect(source).toContain("will atomically bootstrap the branch with its compiler-approved Policy and Work."); expect(source).toContain("Safe-output processing uses only the compiler-approved Policy proposal; never"); expect(source).toContain("no administrator seed is required."); @@ -147,16 +148,20 @@ describe("ESLint factory producer and dispatcher", () => { expect(proposal.pools.default.profiles[worker].logical_contract).toMatch(/^[a-f0-9]{64}$/); } } - expect(source).toContain("github-token: ${{ secrets.GH_AW_GITHUB_TOKEN }}"); - const configMatch = compiled.match(/GH_AW_WORK_QUEUE_CONTROL_CONFIG: ("[^\n]+")/); - expect(configMatch).not.toBeNull(); - const config = JSON.parse(JSON.parse(configMatch[1])); - expect(config["github-token"]).toBe("${{ secrets.GH_AW_GITHUB_TOKEN }}"); - expect(config.work_queue_dispatch_credential).toEqual({ kind: "authenticated" }); - expect([...config.work_queue_workflows].sort()).toEqual([...ESLINT_WORKERS].sort()); + expect(source).not.toMatch(/github-token:/); + const configs = [...compiled.matchAll(/(?:GH_AW_WORK_QUEUE_CONTROL_CONFIG|GH_AW_SAFE_OUTPUTS_HANDLER_CONFIG): ("[^\n]+")/g)].map(([, value]) => { + const config = JSON.parse(JSON.parse(value)); + return config.dispatch_workflow || config; + }); + expect(configs.length).toBeGreaterThan(1); + for (const config of configs) { + expect(config["github-token"]).toBe("${{ secrets.GH_AW_GITHUB_TOKEN || secrets.GITHUB_TOKEN }}"); + expect(config.work_queue_dispatch_credential).toEqual({ kind: "${{ secrets.GH_AW_GITHUB_TOKEN != '' && 'authenticated' || 'github_token' }}" }); + expect([...config.work_queue_workflows].sort()).toEqual([...ESLINT_WORKERS].sort()); + } }); - it("bootstraps an absent queue and launches all three workers through the real trusted control adapter without duplicate launches", async () => { + it.each(["authenticated", "github_token"])("bootstraps an absent queue and launches all three workers with %s credentials without duplicate launches", async kind => { const directory = path.resolve(`.gh-aw-eslint-dispatch-${randomUUID()}`); fs.mkdirSync(directory); const fixture = queueFixture({ granted: false, workerPrincipal: "12" }); @@ -165,6 +170,9 @@ describe("ESLint factory producer and dispatcher", () => { const posts = []; const failures = []; const compiled = fs.readFileSync(new URL("../../../.github/workflows/eslint-factory-dispatcher.lock.yml", import.meta.url), "utf8"); + const configMatch = compiled.match(/GH_AW_WORK_QUEUE_CONTROL_CONFIG: ("[^\n]+")/); + expect(configMatch).not.toBeNull(); + const dispatchConfig = JSON.parse(JSON.parse(configMatch[1])); const [environment] = compiledFactoryPolicyEnvironments(compiled); expect(environment).toBeDefined(); const policy = JSON.parse(readWorkQueuePolicyConfig(environment).replaceAll("${{ github.repository }}", REPOSITORY).replaceAll("${{ github.sha }}", REF)); @@ -178,6 +186,11 @@ describe("ESLint factory producer and dispatcher", () => { return { ...response, data: { ...response.data, ref: `refs/${parameters.ref}` } }; }; fake.githubClient.rest.users = fixture.githubClient.rest.users; + fake.githubClient.rest.users.getByUsername = async ({ username }) => { + expect(username).toBe("github-actions[bot]"); + return { status: 200, data: { id: "12", type: "Bot", login: username } }; + }; + fake.githubClient.auth = async () => ({ type: "token", token: "fixture-token" }); const workerFiles = ESLINT_WORKERS.flatMap(profile => [`.github/workflows/${profile}.md`, `.github/workflows/${profile}.lock.yml`]); const fileReads = []; fake.githubClient.rest.repos.getContent = async ({ path: filename, ref }) => { @@ -224,15 +237,7 @@ describe("ESLint factory producer and dispatcher", () => { expect(fake.refs.has("work-queue")).toBe(false); const plan = buildESLintFactoryPlan(planOptions); const intentPath = path.join(directory, "intents.jsonl"); - fs.writeFileSync( - intentPath, - [ - { version: 3, intent_id: "factory-submit", kind: "submit", parameters: { nodes: plan.nodes } }, - { version: 3, intent_id: "factory-dispatch", kind: "dispatch_next", parameters: plan.dispatch }, - ] - .map(intent => JSON.stringify(intent)) - .join("\n") + "\n" - ); + stagePlanIntents(intentPath, plan); const controls = { ...options, intentOrigin: snapshot.origin, @@ -241,7 +246,11 @@ describe("ESLint factory producer and dispatcher", () => { expect(token).toBe("fixture-token"); return fake.githubClient; }, - config: { max: 3, work_queue_enabled: true, work_queue_workflows: ESLINT_WORKERS, aw_context_workflows: ESLINT_WORKERS, "github-token": "fixture-token", work_queue_dispatch_credential: { kind: "authenticated" } }, + config: { + ...dispatchConfig, + "github-token": "fixture-token", + work_queue_dispatch_credential: { kind }, + }, }; const result = await processControls(controls); expect(result.success, JSON.stringify({ result, failures })).toBe(true); @@ -274,6 +283,7 @@ describe("ESLint factory producer and dispatcher", () => { const AsyncFunction = Object.getPrototypeOf(async function () {}).constructor; const calls = []; const files = new Map(); + const intents = []; const fakeRequire = name => { if (name === "node:fs") return { @@ -282,6 +292,13 @@ describe("ESLint factory producer and dispatcher", () => { }; if (name === "node:path") return { join: (...parts) => parts.join("/") }; if (name === "/fixture/gh-aw/actions/eslint_factory_portfolio.cjs") return { buildESLintFactoryPlan }; + if (name === "/fixture/gh-aw/actions/work_queue_intents.cjs") + return { + stagePlanIntents: (filename, plan) => { + expect(filename).toBe("/fixture/gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl"); + intents.push(plan); + }, + }; throw new Error(`Unreviewed preparation dependency: ${name}`); }; const github = { @@ -306,6 +323,7 @@ describe("ESLint factory producer and dispatcher", () => { expect(calls).toEqual(["run", "repository"]); expect(files.size).toBe(1); expect(JSON.parse(files.get("/tmp/gh-aw/agent/eslint-factory-plan.json"))).toEqual(buildESLintFactoryPlan(planOptions)); + expect(intents).toEqual([buildESLintFactoryPlan(planOptions)]); }); it("keeps clean scans and absent rule ideas from claiming write-capable no-write Results", () => { diff --git a/actions/setup/js/work_queue_dispatch.cjs b/actions/setup/js/work_queue_dispatch.cjs index 1dcf6da3c3c..95d9d6e4f41 100644 --- a/actions/setup/js/work_queue_dispatch.cjs +++ b/actions/setup/js/work_queue_dispatch.cjs @@ -10,7 +10,7 @@ const { observationRefreshBudget } = require("./work_queue_limits.cjs"); const { assignmentsForRequest, generateRequestOperations, validateWorkerContinuation } = require("./work_queue_replay.cjs"); const store = require("./work_queue_store.cjs"); const { normalizeAssignment, normalizeClaimScope, readClaimScopeContext } = require("./work_queue_claim_scope.cjs"); -const { readStagedIntentBatch, requestIdForIntent, requestForIntent, normalizeDispatchParameters, normalizeSubmitParameters } = require("./work_queue_intents.cjs"); +const { readStagedIntentBatch, requestIdForIntent, requestForIntent, normalizeDispatchParameters, normalizeSubmitParameters, validatePreparedPlanIntentBatch } = require("./work_queue_intents.cjs"); const { assertPolicyProposal, loadQueue, policyProposalFor, publishOperations, validateStoredAssignment, expectedWorkerRun, bindingForRun } = require("./work_queue_binding.cjs"); const { authenticatePublisher, authenticateIntentPublisher, immutableRef, fetchNativeRun, postQueueDispatch, validateNativeRun } = require("./work_queue_native.cjs"); const { dependencyKey, allowedScope, resolveDependencies, resolveExternalEdges } = require("./work_queue_dependency_resolver.cjs"); @@ -484,6 +484,13 @@ async function processWorkQueueIntents(options) { async function processParsedWorkQueueIntents(options, runtime, intents, errors) { log.debug("intents.process.start", { intents: intents.length, parse_errors: errors.length }); + if (runtime.role === "dispatcher" && intents.length === 0 && errors.length === 0) { + errors = [{ reason: "work_queue_dispatcher_intents_missing" }]; + } + const invalidPreparedBatch = validatePreparedPlanIntentBatch(intents, errors); + if (invalidPreparedBatch) { + return { version: 3, receipts: [{ reason: invalidPreparedBatch, status: "blocked" }], remaining_dispatches: options.maxDispatches ?? 1 }; + } let remaining = options.maxDispatches ?? 1; /** @type {Array<{status: string, intent_id?: string, reason?: string, line?: number, claim_handle?: string, request_id?: string, commit_id?: string, success?: boolean, staged?: boolean, dispatches?: number, recovered?: boolean, launches?: object[], acknowledgement_only?: boolean, control?: object | null}>} */ const receipts = errors.map(error => ({ ...error, status: "blocked" })); @@ -615,7 +622,9 @@ async function main(options = {}) { await coreApi.summary.write(); } if (recoveryRequired) { - const failure = "Work queue controls require recovery; inspect the work_queue_requests output and step summary."; + const failure = result.receipts.some(receipt => receipt.reason === "work_queue_dispatcher_intents_missing") + ? "Work queue dispatcher produced no control intents; inspect the preparation step and tool-denial logs." + : "Work queue controls require recovery; inspect the work_queue_requests output and step summary."; if (typeof coreApi.setFailed === "function") coreApi.setFailed(failure); else throw new Error(failure); } diff --git a/actions/setup/js/work_queue_dispatch.test.cjs b/actions/setup/js/work_queue_dispatch.test.cjs index 51cf96a7c8b..484bad2f8d6 100644 --- a/actions/setup/js/work_queue_dispatch.test.cjs +++ b/actions/setup/js/work_queue_dispatch.test.cjs @@ -21,7 +21,7 @@ import { assignmentOnly } from "./work_queue_scheduler.cjs"; import { nodeId } from "./work_queue_graph.cjs"; import { validateStoredAssignment } from "./work_queue_binding.cjs"; import { authenticatePublisher } from "./work_queue_native.cjs"; -import { requestForIntent } from "./work_queue_intents.cjs"; +import { requestForIntent, stagePlanIntents } from "./work_queue_intents.cjs"; import { canonical, digest } from "./work_queue_codec.cjs"; import { queueFixture, DISPATCHER, REF, REPOSITORY } from "./work_queue_lifecycle.test_helpers.cjs"; import { fakeGitHub } from "./work_queue_store_checks.cjs"; @@ -1414,6 +1414,49 @@ describe("native queue launch fencing and conservative recovery", () => { } }); + it.each(["absent", "empty"])("fails an unassigned dispatcher with %s intents instead of reporting a successful activation", async state => { + const { options, post } = setup({ granted: false }); + const directory = fs.mkdtempSync(path.join(fs.realpathSync(os.tmpdir()), "gh-aw-queue-missing-intents-")); + const filename = path.join(directory, "intents.jsonl"); + const core = { info: vi.fn(), setOutput: vi.fn(), setFailed: vi.fn() }; + const publish = vi.fn(options.publishWorkQueueRequest); + try { + if (state === "empty") fs.writeFileSync(filename, ""); + const direct = await processWorkQueueIntents({ ...options, assignment: null, role: "dispatcher", intentPath: filename, publishWorkQueueRequest: publish }); + expect(direct.receipts).toEqual([{ reason: "work_queue_dispatcher_intents_missing", status: "blocked" }]); + const result = await publishQueueControls({ ...options, assignment: null, role: "dispatcher", intentPath: filename, publishWorkQueueRequest: publish, core }); + expect(result).toMatchObject({ status: "recovery_required", success: false }); + expect(result.receipts).toEqual([{ reason: "work_queue_dispatcher_intents_missing", status: "blocked" }]); + expect(core.setFailed).toHaveBeenCalledWith(expect.stringContaining("produced no control intents")); + expect(publish).not.toHaveBeenCalled(); + expect(post).not.toHaveBeenCalled(); + } finally { + fs.rmSync(directory, { recursive: true, force: true }); + } + }); + + it("rejects dispatcher intents appended to a trusted prepared plan before admission", async () => { + const { options, post } = setup({ granted: false }); + const directory = fs.mkdtempSync(path.join(fs.realpathSync(os.tmpdir()), "gh-aw-queue-prepared-plan-")); + const filename = path.join(directory, "intents.jsonl"); + const publish = vi.fn(options.publishWorkQueueRequest); + const plan = { + version: 1, + nodes: [{ pool: "default", payload: { task: "prepared" } }], + dispatch: { pool: "default", max_claims: 1, max_dispatches: 1 }, + }; + try { + stagePlanIntents(filename, plan); + fs.appendFileSync(filename, `${JSON.stringify({ version: 3, intent_id: "agent-extra", kind: "dispatch_next", parameters: plan.dispatch })}\n`); + const result = await processWorkQueueIntents({ ...options, assignment: null, role: "dispatcher", intentPath: filename, publishWorkQueueRequest: publish }); + expect(result.receipts).toEqual([{ reason: "work_queue_plan_intent_batch_invalid", status: "blocked" }]); + expect(publish).not.toHaveBeenCalled(); + expect(post).not.toHaveBeenCalled(); + } finally { + fs.rmSync(directory, { recursive: true, force: true }); + } + }); + it.each([undefined, null, { kind: "unsupported" }, { kind: "github_app" }])("rejects public dispatch credential metadata %j before constructing a client or publishing", async credential => { const { fixture, options, post } = setup({ granted: false }); const directory = fs.mkdtempSync(path.join(fs.realpathSync(os.tmpdir()), "gh-aw-queue-public-credential-")); diff --git a/actions/setup/js/work_queue_documentation.test.cjs b/actions/setup/js/work_queue_documentation.test.cjs index c846cca8c28..b894ec7575f 100644 --- a/actions/setup/js/work_queue_documentation.test.cjs +++ b/actions/setup/js/work_queue_documentation.test.cjs @@ -63,7 +63,7 @@ describe("work-queue deployment documentation", () => { expect(instructions).not.toContain("```json"); expect(instructions).toContain("issue-backed WorkQueueOps"); expect(instructions).toContain("`uninitialized` plus null SHA is empty"); - expect(instructions).toContain("Existing policyless ledgers are failures"); + expect(instructions).toContain("Policyless ledgers fail"); expect(readRepositoryFile(referencePath)).toContain("Work queues can be Git-backed or issue-backed"); for (const file of [deploymentPath, referencePath, specificationPath]) { expect(instructions).toContain(file.replace(/^docs\//, "../../docs/")); @@ -97,9 +97,10 @@ describe("work-queue deployment documentation", () => { expect(dispatcher).toContain('work-queue work_queue_read \'{"pool":"default","limit":32}\''); expect(dispatcher).toContain("Check `queue_state`, not just `total`"); expect(dispatcher).toContain("Treat it as an empty backlog; the first trusted producer submission"); - expect(dispatcher).toContain("Do not dispatch until that submission has been admitted"); + expect(dispatcher).toContain("shared/work-queue-staged-plan.md"); + expect(readRepositoryFile(".github/workflows/shared/work-queue-staged-plan.md")).toContain("Trusted processing verifies the exact batch"); expect(dispatcher).toContain("existing policyless ledger"); - expect(dispatcher).toContain('work-queue work_queue_dispatch_next \'{"pool":"default","max_claims":3,"max_dispatches":3}\''); + expect(dispatcher).toContain('{"pool":"default","max_claims":3,"max_dispatches":3}'); expect(dispatcher).toContain('`status: "staged"`'); expect(dispatcher).toContain("an empty snapshot or a prediction of no eligible Work can be stale"); expect(dispatcher).toContain("Do not call ordinary `dispatch_workflow`"); diff --git a/actions/setup/js/work_queue_intents.cjs b/actions/setup/js/work_queue_intents.cjs index 81c3d3f871d..148e05d00f6 100644 --- a/actions/setup/js/work_queue_intents.cjs +++ b/actions/setup/js/work_queue_intents.cjs @@ -87,6 +87,47 @@ function stageIntent(filename, intent) { log.debug("intent.stage.complete", { staged_intents: previous.length + 1 }); } +function stagePlanIntents(filename, plan) { + if (plan?.version !== 1 || !Array.isArray(plan.nodes) || plan.nodes.length < 1 || plan.nodes.length > 256) throw new Error("work_queue_plan_invalid"); + closed(plan.dispatch, ["pool", "max_claims", "max_dispatches"], [], "planned dispatch"); + identity(plan.dispatch.pool, "pool"); + integer(plan.dispatch.max_claims, 1, 256, "max_claims"); + integer(plan.dispatch.max_dispatches, 1, 256, "max_dispatches"); + for (const node of plan.nodes) { + closed(node, ["payload"], ["graph_id", "node_key", "work_id", "pool", "priority", "fairness_key", "worker_profile", "logical_contract", "execution_ref", "depends_on", "subject", "backing_issue", "replacement_of"], "planned Work"); + if (!node.payload || typeof node.payload !== "object" || Array.isArray(node.payload)) throw new Error("work_queue_plan_payload_invalid"); + canonical(node.payload); + if (identity(node.pool, "pool") !== plan.dispatch.pool) throw new Error("work_queue_plan_pool_mismatch"); + } + const parameters = [ + { kind: "submit", parameters: { nodes: plan.nodes } }, + { kind: "dispatch_next", parameters: plan.dispatch }, + ]; + const id = digest(parameters); + const intents = parameters.map(intent => ({ version: 3, intent_id: `plan:${id}:${intent.kind}`, ...intent })); + const previous = readStagedIntents(filename); + if (previous.length > intents.length || previous.some((intent, index) => canonical(intent) !== canonical(intents[index]))) throw new Error("work_queue_plan_intents_conflict"); + for (const intent of intents) { + if (!previous.some(existing => existing.intent_id === intent.intent_id)) stageIntent(filename, intent); + } + return intents; +} + +function validatePreparedPlanIntentBatch(intents, errors) { + const hasPlanIntent = intents.some(intent => intent.intent_id.startsWith("plan:")) || errors.some(error => error.intent_id?.startsWith("plan:")); + if (!hasPlanIntent) return null; + if (errors.length || intents.length !== 2) return "work_queue_plan_intent_batch_invalid"; + const [submit, dispatch] = intents; + if (submit.kind !== "submit" || dispatch.kind !== "dispatch_next") return "work_queue_plan_intent_batch_invalid"; + const parameters = [ + { kind: "submit", parameters: submit.parameters }, + { kind: "dispatch_next", parameters: dispatch.parameters }, + ]; + const batchId = digest(parameters); + if (submit.intent_id !== `plan:${batchId}:submit` || dispatch.intent_id !== `plan:${batchId}:dispatch_next`) return "work_queue_plan_intent_batch_invalid"; + return null; +} + function requestIdForIntent(trustedContext, intentId) { const actor = actorFromContext(trustedContext); identity(intentId, "intent ID"); @@ -151,4 +192,17 @@ function normalizeSubmitParameters(parameters, policy, at, state) { }; } -module.exports = { MAX_INTENT_BYTES, MAX_INTENTS, readIntentLines, readStagedIntentBatch, readStagedIntents, stageIntent, requestIdForIntent, requestForIntent, normalizeDispatchParameters, normalizeSubmitParameters }; +module.exports = { + MAX_INTENT_BYTES, + MAX_INTENTS, + readIntentLines, + readStagedIntentBatch, + readStagedIntents, + stageIntent, + stagePlanIntents, + validatePreparedPlanIntentBatch, + requestIdForIntent, + requestForIntent, + normalizeDispatchParameters, + normalizeSubmitParameters, +}; diff --git a/actions/setup/js/work_queue_intents.test.cjs b/actions/setup/js/work_queue_intents.test.cjs index 41a0bc7bb92..7881e072b63 100644 --- a/actions/setup/js/work_queue_intents.test.cjs +++ b/actions/setup/js/work_queue_intents.test.cjs @@ -8,7 +8,11 @@ import { newRequest, generateRequestOperations } from "./work_queue_replay.cjs"; import { queueFixture } from "./work_queue_lifecycle.test_helpers.cjs"; import { digest } from "./work_queue_codec.cjs"; import { nodeId } from "./work_queue_graph.cjs"; -import { MAX_INTENTS, MAX_INTENT_BYTES, readStagedIntentBatch, readStagedIntents, requestIdForIntent, requestForIntent, normalizeDispatchParameters, normalizeSubmitParameters, stageIntent } from "./work_queue_intents.cjs"; +import { MAX_INTENTS, MAX_INTENT_BYTES, readStagedIntentBatch, readStagedIntents, requestIdForIntent, requestForIntent, normalizeDispatchParameters, normalizeSubmitParameters, stageIntent, stagePlanIntents } from "./work_queue_intents.cjs"; +import { buildESLintFactoryPlan } from "./eslint_factory_portfolio.cjs"; +import { buildDailyReportPlan } from "./daily_report_portfolio.cjs"; +import { buildEngineConformancePlan } from "./engine_conformance_portfolio.cjs"; +import { main as collectIntents } from "./collect_work_queue_intents.cjs"; const directories = []; const origin = { authenticated: true, roles: ["dispatcher"], role: "dispatcher", principal: "11", repository: "owner/repo", workflow: ".github/workflows/dispatcher.lock.yml", run_id: "15", run_attempt: 1 }; @@ -23,6 +27,80 @@ afterEach(() => { }); describe("trusted stable intent ingestion", () => { + it.each([buildESLintFactoryPlan, buildDailyReportPlan, buildEngineConformancePlan])("stages the exact portfolio submission before dispatch without an agent or credentials", buildPlan => { + const file = filename(); + const plan = buildPlan({ date: "2026-10-08", repository: "owner/repo", repositoryId: "7" }); + const staged = stagePlanIntents(file, plan); + expect(staged.map(intent => intent.kind)).toEqual(["submit", "dispatch_next"]); + expect(staged[0].parameters).toEqual({ nodes: plan.nodes }); + expect(staged[1].parameters).toEqual(plan.dispatch); + expect(readStagedIntents(file)).toEqual(staged); + const original = fs.readFileSync(file, "utf8"); + expect(stagePlanIntents(file, plan)).toEqual(staged); + expect(fs.readFileSync(file, "utf8")).toBe(original); + expect(staged.every(intent => !Object.hasOwn(intent, "claim_handle"))).toBe(true); + }); + + it("rejects invalid or conflicting prepared plans without replacing staged work", () => { + const file = filename(); + const plan = buildESLintFactoryPlan({ date: "2026-10-08", repository: "owner/repo", repositoryId: "7" }); + for (const invalid of [ + null, + {}, + { ...plan, version: 3 }, + { ...plan, nodes: [] }, + { ...plan, nodes: [{ ...plan.nodes[0], payload: null }] }, + { ...plan, nodes: [{ ...plan.nodes[0], payload: [] }] }, + { ...plan, nodes: [{ ...plan.nodes[0], unexpected: true }] }, + { ...plan, dispatch: { ...plan.dispatch, max_claims: 0 } }, + { ...plan, dispatch: { ...plan.dispatch, pool: "other" } }, + ]) { + expect(() => stagePlanIntents(file, invalid)).toThrow(); + expect(fs.existsSync(file)).toBe(false); + } + stagePlanIntents(file, plan); + const original = fs.readFileSync(file, "utf8"); + expect(() => stagePlanIntents(file, { ...plan, nodes: plan.nodes.slice(0, 1) })).toThrow(/conflict/); + expect(fs.readFileSync(file, "utf8")).toBe(original); + }); + + it("recovers a staged submission prefix but rejects dispatch-before-submission", () => { + const file = filename(); + const plan = buildESLintFactoryPlan({ date: "2026-10-08", repository: "owner/repo", repositoryId: "7" }); + const intents = stagePlanIntents(file, plan); + fs.writeFileSync(file, `${JSON.stringify(intents[0])}\n`); + expect(stagePlanIntents(file, plan)).toEqual(intents); + expect(readStagedIntents(file)).toEqual(intents); + const outOfOrder = `${JSON.stringify(intents[1])}\n`; + fs.writeFileSync(file, outOfOrder); + expect(() => stagePlanIntents(file, plan)).toThrow(/conflict/); + expect(fs.readFileSync(file, "utf8")).toBe(outOfOrder); + fs.writeFileSync(file, intents.map(intent => JSON.stringify(intent)).join("\n") + "\n"); + stageIntent(file, { version: 3, intent_id: "extra", kind: "dispatch_next", parameters: plan.dispatch }); + expect(() => stagePlanIntents(file, plan)).toThrow(/conflict/); + }); + + it("collects prepared intents from the same directory as the queue MCP server", () => { + const file = filename(); + const sourceDir = path.dirname(file); + const outputDir = path.join(sourceDir, "collected"); + const intentPath = path.join(sourceDir, "work-queue.intents.jsonl"); + const plan = buildESLintFactoryPlan({ date: "2026-10-08", repository: "owner/repo", repositoryId: "7" }); + const staged = stagePlanIntents(intentPath, plan); + expect( + collectIntents({ + sourceDir, + outputDir, + core: { + setFailed: message => { + throw new Error(message); + }, + }, + }) + ).toEqual([{ filename: "work-queue.intents.jsonl", bytes: fs.statSync(intentPath).size, status: "collected" }]); + expect(readStagedIntents(path.join(outputDir, "work-queue.intents.jsonl"))).toEqual(staged); + }); + it("binds request identities to native origin, never agent authority", () => { const parameters = { pool: "default", max_claims: 1, max_dispatches: 1, max_bytes: 1000 }; const request = requestForIntent(origin, "intent1", "dispatch_next", parameters); diff --git a/docs/src/content/docs/patterns/daily-report-portfolio.md b/docs/src/content/docs/patterns/daily-report-portfolio.md index 4aa32c53787..dde2900bb84 100644 --- a/docs/src/content/docs/patterns/daily-report-portfolio.md +++ b/docs/src/content/docs/patterns/daily-report-portfolio.md @@ -196,9 +196,9 @@ safe-outputs: Read /tmp/gh-aw/agent/daily-report-plan.json. Call work_queue_read with {"pool":"daily-reports","limit":32}. -Call work_queue_submit once with {"nodes": }. -Call work_queue_dispatch_next once with the exact plan.dispatch: -{"pool":"daily-reports","max_claims":3,"max_dispatches":3}. +The preparation step has already staged the exact nodes and dispatch budget. +Do not submit, dispatch, or reconstruct the plan. +Report the staged cohort, not completed work. Do not select winning Work IDs, workflows or revisions from the snapshot. Do not call ordinary dispatch_workflow or target-specific dispatch tools. ``` @@ -218,11 +218,19 @@ fs.writeFileSync( "/tmp/gh-aw/agent/daily-report-plan.json", JSON.stringify(plan) ); +stagePlanIntents( + path.join(process.env.RUNNER_TEMP, "gh-aw/safeoutputs/work-queue/work-queue.intents.jsonl"), + plan +); ``` The JSON file is a preparation artifact, not a second scheduler ledger. Its selection becomes durable through normal Work admission. Queue snapshots are -read-only views and never grants. +read-only views and never grants. Preparation stages one submission followed by +one dispatch intent without agent JSON transcription or shell approval. Trusted +collection and control processing retain the same origin, Policy and credential +checks. A dispatcher with no intents fails rather than reporting a green run +with no admission. ### MCP read, submit and request @@ -233,8 +241,9 @@ server, not operator CLI commands: {"name":"work_queue_read","arguments":{"pool":"daily-reports","limit":32}} ``` -The submit call contains all three complete generated nodes. This JavaScript -excerpt shows the argument shape without repeating their shared contracts: +The preparation step stages the same parameters as the following MCP calls. +The submission contains all three complete generated nodes; the portfolio agent +does not make these calls itself: ```javascript title="MCP tools/call parameters constructed from the prepared plan" const submitCall = { @@ -418,7 +427,8 @@ three artifacts; none substitutes for the required intelligence Discussion. ## One ledger from admission to verified Result -Agent calls stage intents. The trusted publisher owns the following ledger +The trusted preparation step stages portfolio control intents; worker agent +calls stage Claim-scoped effect and finish intents. The trusted publisher owns the following ledger transitions; none can be manufactured by a report worker: ```mermaid @@ -459,7 +469,7 @@ sequenceDiagram | `Dispatch` | Sender fencing, assignment and verified native run binding | | `Completion` | A scoped completed intent accepted by trusted processing | | `Result` | Required output cardinality and independently verified delivery | -| `ClaimCancellation`, `WorkCancellation` | Declined/failed attempt and terminal Work when its one-attempt budget is exhausted | +| `ClaimCancellation`, `WorkCancellation` | Declined/failed attempt and terminal Work when its configured attempt budget is exhausted | | `Release` | Capacity release justified by exact native terminal or definitive nonlaunch evidence | Completion is not Result. An API success response or a native run's success diff --git a/docs/src/content/docs/reference/compilation-process.md b/docs/src/content/docs/reference/compilation-process.md index b7d51f299c0..0ec8d4035ed 100644 --- a/docs/src/content/docs/reference/compilation-process.md +++ b/docs/src/content/docs/reference/compilation-process.md @@ -338,15 +338,20 @@ Set `DEBUG=workflow:compiler_development,cli:compile_development` to log each dry-run configuration mutation, removed environment key, disabled job, and forced CLI flag to stderr. Logs identify changed fields/keys, never their values. -Dry-run locks omit `OTEL_*` and `GH_AW_OTLP_*` variables from workflow, job, +Dry-run locks omit `OTEL_*`, `GH_AW_OTLP_*`, and `GITHUB_AW_OTEL_*` variables, +W3C trace context (`TRACEPARENT`, `TRACESTATE`, `BAGGAGE`), and +`CLAUDE_CODE_ENABLE_TELEMETRY` from workflow, job, step, container, and service environment mappings, including user-defined values. Workflow environment suppression occurs before job and header generation so telemetry-only masking steps and environment-source entries are also omitted. +Engine environment overrides are filtered before native engine configuration is rendered. Automatic OTLP export configuration and telemetry authentication steps are also disabled. Existing network permissions, local diagnostics, summaries, and artifacts remain available; ordinary compilation preserves telemetry configuration. This does not rewrite custom scripts that configure their own exporters. +The emitted lock's `gh-aw-metadata` header records `"dry_run":true`. Normal and +older locks omit this optional field, which readers interpret as `false`. Suppression applies to the lock emitted by `--dry-run`, not a previously compiled normal lock on GitHub. Restoring that normal lock after diagnostic compilation does not disable its telemetry. Any permitted live test must review and execute diff --git a/pkg/workflow/compiler_development_telemetry.go b/pkg/workflow/compiler_development_telemetry.go index 55b80cb6d92..ac3e587fe6c 100644 --- a/pkg/workflow/compiler_development_telemetry.go +++ b/pkg/workflow/compiler_development_telemetry.go @@ -44,6 +44,16 @@ func (c *Compiler) prepareDryRunWorkflowData(data *WorkflowData) (*WorkflowData, delete(result.EnvSources, name) } } + if result.EngineConfig != nil { + engine := *result.EngineConfig + engine.Env = maps.Clone(engine.Env) + for name := range engine.Env { + if isDryRunTelemetryEnv(name) { + delete(engine.Env, name) + } + } + result.EngineConfig = &engine + } return result, nil } @@ -102,7 +112,11 @@ func prepareDryRunWorkflowDispatch(data *WorkflowData) error { } func isDryRunTelemetryEnv(name string) bool { - return strings.HasPrefix(name, "OTEL_") || strings.HasPrefix(name, "GH_AW_OTLP_") + return strings.HasPrefix(name, "OTEL_") || + strings.HasPrefix(name, "GH_AW_OTLP_") || + strings.HasPrefix(name, "GITHUB_AW_OTEL_") || + name == "TRACEPARENT" || name == "TRACESTATE" || name == "BAGGAGE" || + name == "CLAUDE_CODE_ENABLE_TELEMETRY" } // Rewrite only environment mappings so executable scalar contents remain intact. diff --git a/pkg/workflow/compiler_development_telemetry_test.go b/pkg/workflow/compiler_development_telemetry_test.go index 35be135d026..99ee8eefe10 100644 --- a/pkg/workflow/compiler_development_telemetry_test.go +++ b/pkg/workflow/compiler_development_telemetry_test.go @@ -20,6 +20,12 @@ env: &shared Authorization=private X-Tenant=private GH_AW_OTLP_ENDPOINTS: '[{"url":"https://traces.example.com"}]' + GITHUB_AW_OTEL_TRACE_ID: private-trace + GITHUB_AW_OTEL_PARENT_SPAN_ID: private-span + TRACEPARENT: private-parent + TRACESTATE: private-state + BAGGAGE: private-baggage + CLAUDE_CODE_ENABLE_TELEMETRY: "1" START_DATE: 2026-01-01 ANTHROPIC_CUSTOM_HEADERS: "x-aw-gw-github-repo: ${{ github.repository }}" KEEP: | @@ -30,16 +36,18 @@ jobs: env: *shared container: image: node:24 - env: {OTEL_SERVICE_NAME: container, KEEP: container} + env: {OTEL_SERVICE_NAME: container, TRACEPARENT: private-parent, KEEP: container} services: server: image: node:24 env: OTEL_TRACES_EXPORTER: otlp + TRACESTATE: private-state KEEP: service steps: - env: OTEL_SERVICE_NAME: first + BAGGAGE: private-baggage KEEP: first run: echo first - run: | @@ -90,6 +98,11 @@ jobs: assert.Equal(t, map[string]string{"OTEL_SERVICE_NAME": "action-input"}, job.Steps[2].With.Env) assert.Empty(t, job.Steps[3].Env) assert.NotContains(t, content, "Authorization=private") + assert.NotContains(t, content, "private-trace") + assert.NotContains(t, content, "private-span") + assert.NotContains(t, content, "private-parent") + assert.NotContains(t, content, "private-state") + assert.NotContains(t, content, "private-baggage") assert.Contains(t, content, `echo "OTEL_SERVICE_NAME: this is script content"`) assert.Contains(t, content, "env: &shared") assert.Contains(t, content, `ANTHROPIC_CUSTOM_HEADERS: "x-aw-gw-github-repo: ${{ github.repository }}"`) @@ -134,12 +147,18 @@ func TestDryRunTelemetryConfiguration(t *testing.T) { }}}, OTLPEndpoint: "https://traces.example.com", OTLPHeaders: "Authorization=private", OTLPEndpoints: `[{"url":"https://traces.example.com"}]`, OTLPUsesEnterpriseDefaults: true, - Env: "env:\n OTEL_EXPORTER_OTLP_HEADERS: ${{ secrets.OTLP_HEADERS }}\n GH_AW_OTLP_ATTRIBUTES: '{}'\n KEEP: preserved\n", + Env: "env:\n OTEL_EXPORTER_OTLP_HEADERS: ${{ secrets.OTLP_HEADERS }}\n GH_AW_OTLP_ATTRIBUTES: '{}'\n TRACEPARENT: private-parent\n KEEP: preserved\n", EnvSources: map[string]string{ "OTEL_EXPORTER_OTLP_HEADERS": "(main workflow)", "GH_AW_OTLP_ATTRIBUTES": "(main workflow)", + "TRACEPARENT": "(main workflow)", "KEEP": "(main workflow)", }, + EngineConfig: &EngineConfig{Env: map[string]string{ + "TRACEPARENT": "${{ secrets.TRACE_PARENT }}", + "CLAUDE_CODE_ENABLE_TELEMETRY": "1", + "ENGINE_KEEP": "preserved", + }}, } compiler.SetDryRun(true) result, err := compiler.prepareDryRunWorkflowData(data) @@ -155,12 +174,14 @@ func TestDryRunTelemetryConfiguration(t *testing.T) { assert.False(t, isOTLPEnabled(result)) assert.Equal(t, map[string]string{"KEEP": "(main workflow)"}, result.EnvSources) assert.Contains(t, result.Env, "KEEP: preserved") + assert.Equal(t, map[string]string{"ENGINE_KEEP": "preserved"}, result.EngineConfig.Env) + assert.Len(t, data.EngineConfig.Env, 3) assert.Contains(t, data.RawFrontmatter, "observability") assert.NotNil(t, data.ParsedFrontmatter.Observability) assert.Equal(t, "https://traces.example.com", data.OTLPEndpoint) assert.True(t, isOTLPHeadersPresent(data)) assert.True(t, isOTLPAttributesPresent(data)) - assert.Len(t, data.EnvSources, 3) + assert.Len(t, data.EnvSources, 4) compiler.SetDryRun(false) normal, err := compiler.prepareDryRunWorkflowData(data) require.NoError(t, err) @@ -183,9 +204,12 @@ func TestPrepareDryRunWorkflowDataInvalidEnv(t *testing.T) { func TestDryRunCompiledTelemetryEnv(t *testing.T) { for _, tc := range []struct { name, config string + engine string reusable bool }{ {name: "defaults"}, + {name: "claude", engine: "claude"}, + {name: "codex", engine: "codex"}, {name: "explicit", config: "observability:\n otlp:\n endpoint: https://traces.example.com\n headers: ${{ secrets.OTLP_HEADERS }}\n"}, {name: "imported", config: "imports: [shared.md]\n"}, {name: "github-app", config: "observability:\n otlp:\n endpoint: https://traces.example.com\n github-app:\n audience: collector\n"}, @@ -204,6 +228,8 @@ engine: id: copilot env: OTEL_SERVICE_NAME: engine + TRACEPARENT: engine-parent + CLAUDE_CODE_ENABLE_TELEMETRY: "1" ENGINE_KEEP: preserved START_DATE: "2026-01-01" ANTHROPIC_CUSTOM_HEADERS: "x-aw-gw-github-repo: ${{ github.repository }}" @@ -212,24 +238,32 @@ env: OTEL_USER_SECRET: ${{ secrets.USER_TELEMETRY_ONLY }} GH_AW_OTLP_ENDPOINTS: '[{"url":"https://manual.example.com"}]' GH_AW_OTLP_ATTRIBUTES: '{"test": "value"}' + GITHUB_AW_OTEL_TRACE_ID: private-trace + GITHUB_AW_OTEL_PARENT_SPAN_ID: private-span + TRACEPARENT: private-parent + TRACESTATE: private-state + BAGGAGE: private-baggage KEEP: preserved KEEP_LITERAL: OTEL_EXPORTER_OTLP_ENDPOINT OTEL_EXPORTER_OTLP_HEADERS GH_AW_OTLP_ATTRIBUTES tools: github: false pre-steps: - run: echo pre - env: {OTEL_SERVICE_NAME: pre, KEEP: pre} + env: {OTEL_SERVICE_NAME: pre, TRACEPARENT: pre-parent, KEEP: pre} post-steps: - run: echo post - env: {OTEL_SERVICE_NAME: post, KEEP: post} + env: {OTEL_SERVICE_NAME: post, TRACESTATE: post-state, KEEP: post} jobs: custom: runs-on: ubuntu-latest - env: {OTEL_SERVICE_NAME: job, KEEP: job} + env: {OTEL_SERVICE_NAME: job, BAGGAGE: job-baggage, KEEP: job} steps: - run: echo custom - env: {OTEL_SERVICE_NAME: step, KEEP: step} + env: {OTEL_SERVICE_NAME: step, GITHUB_AW_OTEL_TRACE_ID: step-trace, KEEP: step} ` + tc.config + "---\nTest dry-run telemetry isolation.\n" + if tc.engine != "" { + source = strings.Replace(source, "id: copilot", "id: "+tc.engine, 1) + } if tc.reusable { source = strings.Replace(source, "on: workflow_dispatch", "on: workflow_call", 1) } @@ -245,7 +279,13 @@ jobs: content, err := os.ReadFile(filepath.Join(dir, "telemetry.lock.yml")) require.NoError(t, err) compiled := string(content) + metadata, legacy, err := ExtractMetadataFromLockFile(compiled) + require.NoError(t, err) + require.NotNil(t, metadata) + assert.False(t, legacy) + assert.Equal(t, enabled, metadata.DryRun) if enabled { + assert.Contains(t, strings.SplitN(compiled, "\n", 2)[0], `"dry_run":true`) var workflow map[string]any require.NoError(t, yaml.Unmarshal(content, &workflow)) assertNoDryRunTelemetryEnv(t, workflow) @@ -257,6 +297,9 @@ jobs: assert.NotContains(t, compiled, "Mint OTLP") assert.NotContains(t, compiled, "Generate observability summary") assert.NotContains(t, compiled, `"opentelemetry":`) + for _, name := range []string{"TRACEPARENT", "TRACESTATE", "BAGGAGE", "GITHUB_AW_OTEL_", "CLAUDE_CODE_ENABLE_TELEMETRY"} { + assert.NotContains(t, compiled, name) + } assert.NotContains(t, compiled, "# - OTEL_") assert.NotContains(t, compiled, "# - GH_AW_OTLP_") assert.Contains(t, compiled, "ENGINE_KEEP: preserved") @@ -265,8 +308,10 @@ jobs: assert.Contains(t, compiled, `ANTHROPIC_CUSTOM_HEADERS: "x-aw-gw-github-repo: ${{ github.repository }}"`) assertDryRunEngineDate(t, content) } else { + assert.NotContains(t, strings.SplitN(compiled, "\n", 2)[0], `"dry_run"`) assert.Contains(t, compiled, "OTEL_EXPORTER_OTLP_ENDPOINT:") assert.Contains(t, compiled, "OTEL_SERVICE_NAME: engine") + assert.Contains(t, compiled, "TRACEPARENT: engine-parent") assert.Contains(t, compiled, "Mask OTLP telemetry headers") assert.Contains(t, compiled, "Mask OTLP custom attribute values") assert.Contains(t, compiled, "USER_TELEMETRY_ONLY") diff --git a/pkg/workflow/compiler_yaml_header.go b/pkg/workflow/compiler_yaml_header.go index 34c11520129..67341af3323 100644 --- a/pkg/workflow/compiler_yaml_header.go +++ b/pkg/workflow/compiler_yaml_header.go @@ -72,15 +72,16 @@ func (c *Compiler) generateLockMetadataHeader(yaml *strings.Builder, data *Workf agentInfo.AgentImageRunner = resolveAgentImageRunnerIdentifier(data.RawFrontmatter) metadata := GenerateLockMetadata(LockHashInfo{FrontmatterHash: frontmatterHash, BodyHash: bodyHash}, data.StopTime, c.effectiveStrictMode(data.RawFrontmatter), agentInfo) metadata.Docs = data.Docs + metadata.DryRun = data.DryRun if metadata.CompilerVersion == "" && c.GetActionTag() != "" { metadata.CompilerVersion = c.GetVersion() } metadataJSON, err := metadata.ToJSON() if err != nil { // Fallback to legacy format if JSON serialization fails - fmt.Fprintf(yaml, "# frontmatter-hash: %s\n", frontmatterHash) + fmt.Fprintf(yaml, "# frontmatter-hash: %s\n", frontmatterHash) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } else { - fmt.Fprintf(yaml, "# gh-aw-metadata: %s\n", metadataJSON) + fmt.Fprintf(yaml, "# gh-aw-metadata: %s\n", metadataJSON) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } } @@ -104,7 +105,7 @@ func (c *Compiler) generateManifestHeader(yaml *strings.Builder, data *WorkflowD manifest.MCPServers = collectMCPServersForManifest(data) manifest.ThreatDetection = collectDetectionPolicyForManifest(data) if manifestJSON, err := manifest.ToJSON(); err == nil { - fmt.Fprintf(yaml, "# gh-aw-manifest: %s\n", manifestJSON) + fmt.Fprintf(yaml, "# gh-aw-manifest: %s\n", manifestJSON) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } else { compilerYamlHeaderLog.Printf("Failed to serialize gh-aw-manifest: %v. Safe update mode will not be available for future compilations of this workflow.", err) } @@ -126,7 +127,7 @@ func generateDescriptiveHeader(yaml *strings.Builder, data *WorkflowData) { // Split description into lines and prefix each with "# " descriptionLines := strings.SplitSeq(strings.TrimSpace(cleanDescription), "\n") for line := range descriptionLines { - fmt.Fprintf(yaml, "# %s\n", strings.TrimSpace(line)) + fmt.Fprintf(yaml, "# %s\n", strings.TrimSpace(line)) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } @@ -140,12 +141,12 @@ func generateDescriptiveHeader(yaml *strings.Builder, data *WorkflowData) { first := true for line := range intentLines { if first { - fmt.Fprintf(yaml, "# Intent: %s\n", strings.TrimSpace(line)) + fmt.Fprintf(yaml, "# Intent: %s\n", strings.TrimSpace(line)) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. first = false continue } // Indent continuation lines so they stay visually attached to the intent block - fmt.Fprintf(yaml, "# %s\n", strings.TrimSpace(line)) + fmt.Fprintf(yaml, "# %s\n", strings.TrimSpace(line)) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } } @@ -157,7 +158,7 @@ func generateSourceHeader(yaml *strings.Builder, data *WorkflowData) { cleanSource := stringutil.StripANSI(data.Source) // Normalize to Unix paths (forward slashes) for cross-platform compatibility cleanSource = filepath.ToSlash(cleanSource) - fmt.Fprintf(yaml, "# Source: %s\n", cleanSource) + fmt.Fprintf(yaml, "# Source: %s\n", cleanSource) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } // Add manifest of imported/included files if any exist @@ -180,7 +181,7 @@ func generateSourceHeader(yaml *strings.Builder, data *WorkflowData) { cleanFile := stringutil.StripANSI(file) // Normalize to Unix paths (forward slashes) for cross-platform compatibility cleanFile = filepath.ToSlash(cleanFile) - fmt.Fprintf(yaml, "# - %s\n", cleanFile) + fmt.Fprintf(yaml, "# - %s\n", cleanFile) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } @@ -190,7 +191,7 @@ func generateSourceHeader(yaml *strings.Builder, data *WorkflowData) { cleanFile := stringutil.StripANSI(file) // Normalize to Unix paths (forward slashes) for cross-platform compatibility cleanFile = filepath.ToSlash(cleanFile) - fmt.Fprintf(yaml, "# - %s\n", cleanFile) + fmt.Fprintf(yaml, "# - %s\n", cleanFile) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } } @@ -211,7 +212,7 @@ func generateConfigHeader(yaml *strings.Builder, data *WorkflowData, secrets, ac // Sort keys for deterministic output keys := sliceutil.SortedKeys(data.EnvSources) for _, k := range keys { - fmt.Fprintf(yaml, "# - %s: %s\n", k, data.EnvSources[k]) + fmt.Fprintf(yaml, "# - %s: %s\n", k, data.EnvSources[k]) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } @@ -220,7 +221,7 @@ func generateConfigHeader(yaml *strings.Builder, data *WorkflowData, secrets, ac yaml.WriteString("#\n") yaml.WriteString("# Secrets used:\n") for _, s := range secrets { - fmt.Fprintf(yaml, "# - %s\n", s) + fmt.Fprintf(yaml, "# - %s\n", s) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } @@ -229,7 +230,7 @@ func generateConfigHeader(yaml *strings.Builder, data *WorkflowData, secrets, ac yaml.WriteString("#\n") yaml.WriteString("# Custom actions used:\n") for _, a := range actions { - fmt.Fprintf(yaml, "# - %s\n", a) + fmt.Fprintf(yaml, "# - %s\n", a) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } @@ -238,7 +239,7 @@ func generateConfigHeader(yaml *strings.Builder, data *WorkflowData, secrets, ac yaml.WriteString("#\n") yaml.WriteString("# Container images used:\n") for _, img := range data.DockerImages { - fmt.Fprintf(yaml, "# - %s\n", img) + fmt.Fprintf(yaml, "# - %s\n", img) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } } } @@ -248,14 +249,14 @@ func generateApprovalHeader(yaml *strings.Builder, data *WorkflowData) { if data.StopTime != "" { yaml.WriteString("#\n") cleanStopTime := stringutil.StripANSI(data.StopTime) - fmt.Fprintf(yaml, "# Effective stop-time: %s\n", cleanStopTime) + fmt.Fprintf(yaml, "# Effective stop-time: %s\n", cleanStopTime) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } // Add manual-approval comment if configured if data.ManualApproval != "" { yaml.WriteString("#\n") cleanManualApproval := stringutil.StripANSI(data.ManualApproval) - fmt.Fprintf(yaml, "# Manual approval required: environment '%s'\n", cleanManualApproval) + fmt.Fprintf(yaml, "# Manual approval required: environment '%s'\n", cleanManualApproval) //nolint:fprintferrorunchecked // strings.Builder writes cannot fail. } yaml.WriteString("\n") diff --git a/pkg/workflow/lock_schema.go b/pkg/workflow/lock_schema.go index 6fdf485d06e..5ea20da3678 100644 --- a/pkg/workflow/lock_schema.go +++ b/pkg/workflow/lock_schema.go @@ -40,6 +40,7 @@ type LockMetadata struct { CompilerVersion string `json:"compiler_version,omitempty"` Docs string `json:"docs,omitempty"` Strict bool `json:"strict,omitempty"` + DryRun bool `json:"dry_run,omitempty"` // AgentMetadataInfo is embedded so agent fields are declared once and // serialized inline in the lock metadata JSON. AgentMetadataInfo @@ -77,7 +78,7 @@ func ExtractMetadataFromLockFile(content string) (*LockMetadata, bool, error) { matches := lockMetadataPattern.FindStringSubmatch(content) if len(matches) >= 2 { - jsonStr := matches[1] + jsonStr := matches[1] //nolint:uncheckedsliceindex // The length check above guarantees this capture exists. var metadata LockMetadata if err := json.Unmarshal([]byte(jsonStr), &metadata); err != nil { return nil, false, fmt.Errorf("lock metadata JSON should be a single valid JSON object; recompile the workflow with gh aw compile to regenerate the lock file: %w", err) @@ -90,7 +91,7 @@ func ExtractMetadataFromLockFile(content string) (*LockMetadata, bool, error) { if matches := lockHashPattern.FindStringSubmatch(content); len(matches) >= 2 { lockSchemaLog.Print("Legacy lock file detected (no schema version)") // Return a minimal metadata struct with just the hash for legacy files - return &LockMetadata{FrontmatterHash: matches[1]}, true, nil + return &LockMetadata{FrontmatterHash: matches[1]}, true, nil //nolint:uncheckedsliceindex // The length check guarantees this capture exists. } // No metadata found at all @@ -101,7 +102,7 @@ func ExtractMetadataFromLockFile(content string) (*LockMetadata, bool, error) { func formatSupportedVersions() string { versions := make([]string, len(SupportedSchemaVersions)) for i, v := range SupportedSchemaVersions { - versions[i] = string(v) + versions[i] = string(v) //nolint:uncheckedsliceindex // versions has the same length as SupportedSchemaVersions. } return strings.Join(versions, ", ") } diff --git a/pkg/workflow/lock_schema_test.go b/pkg/workflow/lock_schema_test.go index 79f340b408e..6a91e3831f7 100644 --- a/pkg/workflow/lock_schema_test.go +++ b/pkg/workflow/lock_schema_test.go @@ -9,6 +9,30 @@ import ( "github.com/stretchr/testify/require" ) +func TestLockMetadataDryRunRoundTrip(t *testing.T) { + for _, dryRun := range []bool{false, true} { + t.Run(map[bool]string{false: "normal", true: "dry-run"}[dryRun], func(t *testing.T) { + expected := &LockMetadata{SchemaVersion: LockSchemaV4, DryRun: dryRun} + content, err := expected.ToJSON() + require.NoError(t, err) + metadata, legacy, err := ExtractMetadataFromLockFile("# gh-aw-metadata: " + content + "\n") + require.NoError(t, err) + assert.False(t, legacy) + assert.Equal(t, expected, metadata) + if dryRun { + assert.Contains(t, content, `"dry_run":true`) + } else { + assert.NotContains(t, content, `"dry_run"`) + } + }) + } + metadata, _, err := ExtractMetadataFromLockFile(`# gh-aw-metadata: {"schema_version":"v4","dry_run":false}`) + require.NoError(t, err) + assert.False(t, metadata.DryRun) + _, _, err = ExtractMetadataFromLockFile(`# gh-aw-metadata: {"schema_version":"v4","dry_run":"true"}`) + require.Error(t, err) +} + func TestExtractMetadataFromLockFile(t *testing.T) { tests := []struct { name string From 7c22036b01a27fe784b05ba466304ae7fa6efc89 Mon Sep 17 00:00:00 2001 From: pelikhan Date: Sun, 11 Oct 2026 09:14:36 -0700 Subject: [PATCH 2/5] Upgrade verified Agy runtime to 1.3.3 Retain explicit verified 1.3.1 compatibility. Compiler default expectations depend on the coordinated DefaultAgyVersion 1.3.3 update; harness and authentication mock regressions pass independently. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> --- actions/setup/js/agy_harness.cjs | 7 +++++-- docs/src/content/docs/engines/agy.md | 19 +++++++++++++++---- pkg/workflow/agy_engine_test.go | 25 ++++++++++++++++++------- pkg/workflow/agy_engine_validation.go | 4 ++-- pkg/workflow/agy_harness_test.go | 22 ++++++++++++++++++++-- pkg/workflow/data/engines/agy.md | 2 +- scripts/agy-authentication.cjs | 2 +- scripts/agy-authentication.test.cjs | 4 ++++ 8 files changed, 66 insertions(+), 19 deletions(-) diff --git a/actions/setup/js/agy_harness.cjs b/actions/setup/js/agy_harness.cjs index c8769ebac91..047498e24fb 100644 --- a/actions/setup/js/agy_harness.cjs +++ b/actions/setup/js/agy_harness.cjs @@ -9,14 +9,17 @@ const path = require("node:path"); const { fetchAWFReflect, deriveBaseUrlFromModelsURL } = require("./awf_reflect.cjs"); const [command, ...commandArgs] = process.argv.slice(2); const log = message => process.stderr.write(`[agy-harness] ${message}\n`); -const checksums = { "1.3.1": "0e313b309ea58c71431ce86bb820936a3700e17e44eabce7bf2264617dc822db" }; +const checksums = { + "1.3.1": "0e313b309ea58c71431ce86bb820936a3700e17e44eabce7bf2264617dc822db", + "1.3.3": "8ee3ca32574c431285efbf4d4732f7f8d53e959370bc4a61646e4fa496f7f2b6", +}; const fail = (result, action) => { if (result.error || result.signal || result.status !== 0) throw new Error(`${action} failed`); }; const main = async () => { const version = process.env.GH_AW_ENGINE_VERSION; - if (!version || !Object.hasOwn(checksums, version)) throw new Error("Agy requires the verified 1.3.1 release"); + if (!version || !Object.hasOwn(checksums, version)) throw new Error("Agy requires a verified 1.3.1 or 1.3.3 release"); if (!command) throw new Error("Agy command is required"); const workspace = process.env.GITHUB_WORKSPACE; const promptPath = process.env.GH_AW_PROMPT; diff --git a/docs/src/content/docs/engines/agy.md b/docs/src/content/docs/engines/agy.md index dc8675c8eac..887fcccab58 100644 --- a/docs/src/content/docs/engines/agy.md +++ b/docs/src/content/docs/engines/agy.md @@ -5,7 +5,7 @@ description: Configure the experimental Google Antigravity CLI engine with Gemin > [!WARNING] > Agy is an experimental built-in engine, not a Gemini alias or a feature-equivalent -> replacement. Initial support is Linux x64 with native CLI v1.3.1 and Gemini +> replacement. Support is Linux x64 with native CLI v1.3.3 and Gemini > API-key authentication. ADC, Google WIF and Vertex AI are not supported. ## Selection and authentication @@ -27,7 +27,7 @@ engine: agy engine: id: agy model: gemini-3.8-flash-medium - version: "1.3.1" + version: "1.3.3" ``` Configure `GEMINI_API_KEY` as a repository secret, for example with @@ -48,8 +48,9 @@ not `google/`, `gemini/` or Copilot provider prefixes. Availability depends on the native release and the API key's access; an unknown or inaccessible model fails the run. -The harness downloads the native Linux x64 v1.3.1 release, verifies its published +The harness downloads the native Linux x64 v1.3.3 release, verifies its published SHA-256 checksum, extracts only `antigravity`, and verifies the executable version. +An explicit `version: "1.3.1"` retains the previous verified release. Other releases and architectures are not supported. A custom `engine.command` must report the same verified version. Installation and settings are temporary and removed after execution; no inherited user authentication profile is used. @@ -89,12 +90,20 @@ remain absent. Unrecognized native events retain their payloads as extensions. The parser regression fixture samples the native transcript and published artifacts from [Smoke Agy run 37848575608](https://github.com/github/gh-aw/actions/runs/37848575608). +All 17 per-step accounting observations are also retained in a sanitized fixture; +their token sums match the native cumulative result. The appended legacy summary +does not override native accounting. The run's historical `agent-session.jsonl` +omits observations and incorrectly marks input as including cache; raw native +stdio is required to reconstruct those observations. Native inference succeeded, but the workflow's conformance checker failed; this is not evidence of a passing production gate. The successful [authentication run 37732637929](https://github.com/github/gh-aw/actions/runs/37732637929) publishes only a sanitized receipt, including negative-probe status and usage, not the native transcript. Reasoning, refusal, and additional failure cases in the parser tests are synthetic, not observations from these runs. +The [v1.3.3 release](https://github.com/google-antigravity/antigravity-cli/releases/tag/1.3.3) +and current headless documentation retain the streaming envelope and token fields. +The parser's live evidence remains v1.3.1; no v1.3.3 workflow execution is claimed. Agent writes to `GITHUB_STEP_SUMMARY` use an isolated file that is appended to the runner's step summary only after secret redaction, matching other built-in engines. @@ -117,6 +126,8 @@ scoped `permissions.allow` rules, but this integration does not yet translate workflow tool restrictions into that native policy. Without advance grants, approval-required tools are soft-denied in headless mode, which the gh-aw harness treats as a failure. See the [native headless permission documentation](https://antigravity.google/docs/cli/headless). +Since v1.3.2, `--dangerously-skip-permissions` does not auto-approve plans in +`/plan` mode. The built-in headless profile does not select that mode. Per-command bash restrictions, `bash: false`, empty bash allowlists, and disabling native editing or web tools are rejected rather than silently ignored. The fixed native timeout is five minutes, with @@ -193,7 +204,7 @@ engine is an explicit choice, not an automatic migration: | Gemini configuration | Experimental Agy configuration | |---|---| | `engine: gemini` | `engine: agy` | -| Gemini CLI version pin | Verified native `version: "1.3.1"` only | +| Gemini CLI version pin | Verified native `version: "1.3.3"`; explicit `"1.3.1"` remains supported | | Gemini model name | Native Agy slug, such as `gemini-3.8-flash-medium` | | `GEMINI_API_KEY` | Same secret name; private `modelProvider: gemini` settings | | Gemini settings, hooks or customizations | Not copied; review native configuration differences | diff --git a/pkg/workflow/agy_engine_test.go b/pkg/workflow/agy_engine_test.go index a016a61d657..ece86c301da 100644 --- a/pkg/workflow/agy_engine_test.go +++ b/pkg/workflow/agy_engine_test.go @@ -34,7 +34,7 @@ func TestAgyBuiltInRegistration(t *testing.T) { require.NoError(t, err) assert.IsType(t, engine, registered) assert.True(t, engine.IsExperimental()) - assert.Equal(t, "1.3.1", def.Version) + assert.Equal(t, "1.3.3", def.Version) assert.False(t, engine.GetCapabilities().BashCommandAllowlist) assert.False(t, engine.GetCapabilities().BashDisable) assert.Contains(t, NewEngineCatalog(NewEngineRegistry()).IDs(), "agy") @@ -46,7 +46,7 @@ func TestAgyBuiltInRegistration(t *testing.T) { assert.Contains(t, engine.GetAgentManifestPathPrefixes(), ".agents/") assert.Contains(t, engine.GetAgentManifestPathPrefixes(), ".gemini/") assert.Contains(t, NewEngineRegistry().GetAllAgentManifestFolders(), ".agents") - assert.Equal(t, "1.3.1", getVersionForSetup(&WorkflowData{AI: "agy"}, NewEngineRegistry())) + assert.Equal(t, "1.3.3", getVersionForSetup(&WorkflowData{AI: "agy"}, NewEngineRegistry())) assert.Equal(t, string(constants.CopilotEngine), constants.EngineOptions[0].Value) } @@ -57,6 +57,8 @@ func TestAgyCompilerSelectionAndRestrictions(t *testing.T) { {"short form", "agy", "bash: [\"*\"]", ""}, {"object form", "\n id: agy\n model: gemini-3.8-flash-medium", "bash: [\"*\"]", ""}, {"custom trusted executable", "\n id: agy\n command: /opt/trusted/agy", "bash: [\"*\"]", ""}, + {"verified latest version", "\n id: agy\n version: \"1.3.3\"", "bash: [\"*\"]", ""}, + {"verified legacy version", "\n id: agy\n version: \"1.3.1\"", "bash: [\"*\"]", ""}, {"WIF", "\n id: agy\n auth:\n type: github-oidc\n provider: gcp\n workload-identity-provider: projects/1/locations/global/workloadIdentityPools/test/providers/test\n service-account: test@example.iam.gserviceaccount.com", "bash: [\"*\"]", "Retain engine: gemini"}, {"extra CLI arguments", "\n id: agy\n args: [\"--prompt\", \"override\"]", "bash: [\"*\"]", "headless profile"}, {"custom harness", "\n id: agy\n harness: custom.cjs", "bash: [\"*\"]", "engine.harness"}, @@ -83,7 +85,11 @@ func TestAgyCompilerSelectionAndRestrictions(t *testing.T) { lock, err := os.ReadFile(filepath.Join(dir, "agy.lock.yml")) require.NoError(t, err) assert.Contains(t, string(lock), "agy_harness.cjs") - assert.Contains(t, string(lock), "GH_AW_ENGINE_VERSION: 1.3.1") + version := "1.3.3" + if tt.name == "verified legacy version" { + version = "1.3.1" + } + assert.Contains(t, string(lock), "GH_AW_ENGINE_VERSION: "+version) assert.Contains(t, string(lock), "GH_AW_AGY_MODEL: gemini-3.8-flash-medium") assert.Contains(t, string(lock), "--exclude-env GEMINI_API_KEY") assert.Contains(t, string(lock), "convert_gateway_config_agy.cjs") @@ -117,7 +123,8 @@ func TestAgyInstallationDoesNotMutateOptionalConfiguration(t *testing.T) { {"nil workflow", nil}, {"nil engine config", &WorkflowData{AI: "agy"}}, {"empty version", &WorkflowData{AI: "agy", EngineConfig: &EngineConfig{ID: "agy"}}}, - {"explicit version", &WorkflowData{AI: "agy", EngineConfig: &EngineConfig{ID: "agy", Version: "1.3.1"}}}, + {"explicit version", &WorkflowData{AI: "agy", EngineConfig: &EngineConfig{ID: "agy", Version: "1.3.3"}}}, + {"legacy version", &WorkflowData{AI: "agy", EngineConfig: &EngineConfig{ID: "agy", Version: "1.3.1"}}}, } { t.Run(tt.name, func(t *testing.T) { var version string @@ -128,7 +135,11 @@ func TestAgyInstallationDoesNotMutateOptionalConfiguration(t *testing.T) { require.NotEmpty(t, steps) assert.Equal(t, GenerateNodeJsSetupStep(), steps[0]) if tt.data != nil { - assert.Equal(t, "1.3.1", getInstallationVersion(tt.data, engine, NewEngineRegistry())) + expected := "1.3.3" + if version != "" { + expected = version + } + assert.Equal(t, expected, getInstallationVersion(tt.data, engine, NewEngineRegistry())) if tt.data.EngineConfig != nil { assert.Equal(t, version, tt.data.EngineConfig.Version) } @@ -211,7 +222,7 @@ func TestAgyNativeRuntimeDefaults(t *testing.T) { assert.Contains(t, content, "agy_harness.cjs agy") assert.Contains(t, content, "awf --config") assert.Contains(t, content, "AWF_REFLECT_ENABLED: 1") - assert.Contains(t, content, "GH_AW_ENGINE_VERSION: 1.3.1") + assert.Contains(t, content, "GH_AW_ENGINE_VERSION: 1.3.3") assert.Contains(t, content, "GH_AW_AGY_MODEL: gemini-3.8-flash-medium") assert.Contains(t, content, "--exclude-env GEMINI_API_KEY") assert.Equal(t, "parse_agy_log", engine.GetLogParserScriptId()) @@ -226,7 +237,7 @@ func TestAgyCLIOverrideUsesBuiltInDefaults(t *testing.T) { require.NoError(t, NewCompiler(WithEngineOverride("agy")).CompileWorkflow(source)) lock, err := os.ReadFile(filepath.Join(dir, "override.lock.yml")) require.NoError(t, err) - assert.Contains(t, string(lock), "GH_AW_ENGINE_VERSION: 1.3.1") + assert.Contains(t, string(lock), "GH_AW_ENGINE_VERSION: 1.3.3") assert.Contains(t, string(lock), "GH_AW_AGY_MODEL: gemini-3.8-flash-medium") assert.Contains(t, string(lock), "agy_harness.cjs") assert.NotContains(t, string(lock), "@google/gemini-cli") diff --git a/pkg/workflow/agy_engine_validation.go b/pkg/workflow/agy_engine_validation.go index a9127f609c1..a4350cdc828 100644 --- a/pkg/workflow/agy_engine_validation.go +++ b/pkg/workflow/agy_engine_validation.go @@ -35,8 +35,8 @@ func validateAgyEngineConfig(config *EngineConfig) error { if config.MaxTurns != "" || config.MaxContinuations > 0 { return errors.New("experimental agy does not support max-turns or max-continuations; use max-turn-cache-misses, max-ai-credits and timeout-minutes to bound execution") } - if config.Version != "" && config.Version != string(constants.DefaultAgyVersion) && !strings.Contains(config.Version, "${{") { - return fmt.Errorf("experimental agy has a verified native archive for version %s only; requested engine.version %q is not supported", constants.DefaultAgyVersion, config.Version) + if config.Version != "" && config.Version != string(constants.DefaultAgyVersion) && config.Version != "1.3.1" && !strings.Contains(config.Version, "${{") { + return fmt.Errorf("experimental agy has a verified native archive for versions %s and 1.3.1 only; requested engine.version %q is not supported", constants.DefaultAgyVersion, config.Version) } return nil } diff --git a/pkg/workflow/agy_harness_test.go b/pkg/workflow/agy_harness_test.go index 4a0548d287d..abe6ff84ba1 100644 --- a/pkg/workflow/agy_harness_test.go +++ b/pkg/workflow/agy_harness_test.go @@ -30,7 +30,7 @@ func agyHarnessCommand(t *testing.T, body string, reflectJSON string) (*exec.Cmd require.NoError(t, err) require.NoError(t, os.WriteFile(filepath.Join(dir, "awf_reflect.cjs"), []byte("module.exports = { ...require("+string(module)+"), fetchAWFReflect: async () => JSON.parse(process.env.AGY_TEST_REFLECT) };"), 0o600)) binary := filepath.Join(dir, "native-agy") - fixture := "#!/usr/bin/env node\nif (process.argv.includes('--version')) { console.log('1.3.1'); process.exit(0); }\n" + body + fixture := "#!/usr/bin/env node\nif (process.argv.includes('--version')) { console.log('1.3.3'); process.exit(0); }\n" + body require.NoError(t, os.WriteFile(binary, []byte(fixture), 0o700)) prompt := filepath.Join(dir, "prompt with spaces.txt") require.NoError(t, os.WriteFile(prompt, []byte("Literal $(touch SHOULD_NOT_EXIST)\n\"quoted\"; --model not-an-argument"), 0o600)) @@ -39,7 +39,7 @@ func agyHarnessCommand(t *testing.T, body string, reflectJSON string) (*exec.Cmd cmd := exec.CommandContext(ctx, "node", harness, binary) cmd.Env = []string{ "PATH=" + os.Getenv("PATH"), "HOME=" + dir, "GITHUB_WORKSPACE=" + dir, - "GH_AW_ENGINE_VERSION=1.3.1", "GH_AW_AGY_MODEL=gemini-3.8-flash-medium", + "GH_AW_ENGINE_VERSION=1.3.3", "GH_AW_AGY_MODEL=gemini-3.8-flash-medium", "GH_AW_PROMPT=" + prompt, "GEMINI_API_KEY=host-test-key", "GOOGLE_APPLICATION_CREDENTIALS=/private/adc.json", "GOOGLE_API_KEY=other-test-key", "AWF_REFLECT_ENABLED=1", "AGY_TEST_REFLECT=" + reflectJSON, @@ -237,6 +237,24 @@ func TestAgyHarnessRejectsWrongCustomExecutableVersion(t *testing.T) { assert.NotContains(t, string(out), "must not execute") } +func TestAgyHarnessRetainsVerifiedLegacyVersion(t *testing.T) { + body := `console.log(JSON.stringify({event:"result",result:{status:"SUCCESS",num_turns:1,usage:{input_tokens:10,output_tokens:2}}}));` + cmd, _ := agyHarnessCommand(t, body, `{"ok":true,"reflectData":{"endpoints":[{"configured":true,"provider":"gemini","models_url":"http://api-proxy:10004/v1beta/models"}]}}`) + binary := cmd.Args[2] + fixture, err := os.ReadFile(binary) + require.NoError(t, err) + require.NoError(t, os.WriteFile(binary, []byte(strings.ReplaceAll(string(fixture), "1.3.3", "1.3.1")), 0o700)) + for index, value := range cmd.Env { + if value == "GH_AW_ENGINE_VERSION=1.3.3" { + cmd.Env[index] = "GH_AW_ENGINE_VERSION=1.3.1" + } + } + out, err := cmd.CombinedOutput() + require.NoError(t, err, "%s", out) + assert.Contains(t, string(out), "verified experimental Agy 1.3.1") + assert.NotContains(t, string(out), "session.error") +} + func TestAgyRuntimeScriptsHaveValidSyntax(t *testing.T) { for name, script := range map[string][]byte{ "harness": agyRuntimeScript(t, "agy_harness.cjs"), diff --git a/pkg/workflow/data/engines/agy.md b/pkg/workflow/data/engines/agy.md index 9570b90bb8a..9507857a082 100644 --- a/pkg/workflow/data/engines/agy.md +++ b/pkg/workflow/data/engines/agy.md @@ -6,7 +6,7 @@ engine: experimental: true detection-engine: copilot runtime-id: agy - version: "1.3.1" + version: "1.3.3" provider: name: google models: diff --git a/scripts/agy-authentication.cjs b/scripts/agy-authentication.cjs index 8d990e86446..92e7f2e1b5f 100644 --- a/scripts/agy-authentication.cjs +++ b/scripts/agy-authentication.cjs @@ -7,7 +7,7 @@ const http = require("node:http"); const os = require("node:os"); const path = require("node:path"); -const VERSION = "1.3.1"; +const VERSION = "1.3.3"; const TERMINAL_FAILURES = new Set(["ERROR", "CANCELED", "INTERRUPTED", "INVALID"]); const STATUSES = new Set(["SUCCESS", ...TERMINAL_FAILURES, "WAITING", "RUNNING"]); const USAGE_FIELDS = ["input_tokens", "output_tokens", "thinking_tokens", "cache_read_tokens", "total_tokens"]; diff --git a/scripts/agy-authentication.test.cjs b/scripts/agy-authentication.test.cjs index 7bdb366c292..6f1d0091cca 100644 --- a/scripts/agy-authentication.test.cjs +++ b/scripts/agy-authentication.test.cjs @@ -12,6 +12,10 @@ const eventResult = result => JSON.stringify({ event: "result", result }) + "\n" const completed = stdout => ({ code: 0, signal: null, stdout, stderr: "", timedOut: false, outputLimit: false, interrupted: false }); const failed = message => ({ ...completed(eventResult({ status: "ERROR", error: message })), code: 1 }); +test("the native authentication probe targets the latest verified release", () => { + assert.equal(VERSION, "1.3.3"); +}); + test("parses native streams and startup failure envelopes, rejects malformed events", () => { assert.deepEqual(parseEvents(eventResult({ status: "SUCCESS" })), [{ event: "result", result: { status: "SUCCESS" } }]); assert.deepEqual(parseEvents('{"status":"ERROR","error":"invalid model"}'), [{ event: "result", result: { status: "ERROR", error: "invalid model" } }]); From a9286c2d9170665a0d55db8ad2b999eae849ba97 Mon Sep 17 00:00:00 2001 From: pelikhan Date: Sun, 11 Oct 2026 09:15:14 -0700 Subject: [PATCH 3/5] Reuse canonical usage reconciliation for Agy traces Keep only native thinking/cache aliases in the adapter; preserve uncached input semantics, cumulative snapshots, and canonical overflow evidence. Add sanitized full accounting from run 37848575608 and verify legacy summaries cannot override native usage. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> --- actions/setup/js/fixtures/agy_ci_sessions.cjs | 35 ++++++++++++++++- actions/setup/js/parse_agy_log.cjs | 21 +++++----- .../js/parse_agy_log_conformance.test.cjs | 38 ++++++++++++++++++- 3 files changed, 80 insertions(+), 14 deletions(-) diff --git a/actions/setup/js/fixtures/agy_ci_sessions.cjs b/actions/setup/js/fixtures/agy_ci_sessions.cjs index 0879c194f00..142961b6f8a 100644 --- a/actions/setup/js/fixtures/agy_ci_sessions.cjs +++ b/actions/setup/js/fixtures/agy_ci_sessions.cjs @@ -2,6 +2,8 @@ // https://github.com/github/gh-aw/actions/runs/37848575608 (failed conformance, // successful agent execution). Paths, conversation IDs and nonce payloads are // replaced; states, missing fields, durations, text and accounting are retained. +// Rechecked against agent artifact 11581176766 on 2026-10-11. Native engine +// version: 1.3.1; workflow commit: badfd988eb7195722b6ec5e618c0064ce23564ca. const conversation = "agy-ci-conversation"; const step = data => ({ event: "step_update", step_update: { conversation_id: conversation, ...data } }); @@ -61,4 +63,35 @@ const agySmoke = [ }, ]; -module.exports = { agySmoke }; +// All native per-step accounting observations from the same trace, without +// prompt, response, paths or tool payloads. The appended legacy summary is not +// native accounting: it incorrectly marks input tokens as including cache. +const agyAccounting = [ + [17580, 544, 492, 0, 18124], + [2095, 247, 159, 16425, 2342], + [2502, 282, 154, 16416, 2784], + [3166, 94, 17, 16472, 3260], + [3417, 105, 27, 16463, 3522], + [3763, 200, 75, 16453, 3963], + [4352, 294, 220, 16444, 4646], + [4945, 193, 89, 16518, 5138], + [5259, 741, 654, 16509, 6000], + [2125, 554, 276, 20807, 2679], + [2824, 64, 12, 20901, 2888], + [3298, 348, 274, 20884, 3646], + [3828, 91, 15, 20926, 3919], + [4171, 377, 293, 20911, 4548], + [4900, 155, 86, 20946, 5055], + [5551, 82, 20, 20927, 5633], + [5715, 371, 358, 20916, 6086], +].map(([input_tokens, output_tokens, thinking_tokens, cache_read_tokens, total_tokens], index) => + step({ step_index: index * 2 + 1, state: "DONE", step_type: "agent_response", usage: { input_tokens, output_tokens, thinking_tokens, cache_read_tokens, total_tokens } }) +); + +const agyLegacySummary = { + type: "result", + num_turns: 1, + usage: { input_tokens: 79491, output_tokens: 4742, cache_read_input_tokens: 298918, total_tokens: 84233, reasoning_output_tokens: 3221, input_tokens_include_cache: true }, +}; + +module.exports = { agySmoke, agyAccounting, agyLegacySummary }; diff --git a/actions/setup/js/parse_agy_log.cjs b/actions/setup/js/parse_agy_log.cjs index 583000a2cb5..837246bc43d 100644 --- a/actions/setup/js/parse_agy_log.cjs +++ b/actions/setup/js/parse_agy_log.cjs @@ -2,7 +2,7 @@ "use strict"; const { createEngineLogParser, generateCopilotCliStyleSummary, buildStepSummaryDetailsSection } = require("./log_parser_shared.cjs"); -const { createSessionEvent, isSessionEvent, isTokenCount, isMetric } = require("./agent_session.cjs"); +const { createSessionEvent, isSessionEvent, isTokenCount, isMetric, reconcileSessionUsage } = require("./agent_session.cjs"); const { getMessageRefusal } = require("./provider_refusal.cjs"); const main = createEngineLogParser({ parserName: "Agy", parseFunction: parseAgyLog, supportsDirectories: false }); @@ -23,22 +23,19 @@ const isObject = value => !!value && typeof value === "object" && !Array.isArray */ function agyUsage(native, emit, previous) { if (!isObject(native)) return previous; - const usage = { ...previous, ...native }; + const snapshot = { ...native }; for (const [field, canonical] of [ - ["input_tokens", "input_tokens"], - ["output_tokens", "output_tokens"], ["thinking_tokens", "reasoning_output_tokens"], ["cache_read_tokens", "cache_read_input_tokens"], - ["total_tokens", "total_tokens"], ]) { - delete usage[field]; - if (isTokenCount(native[field])) usage[canonical] = native[field]; - else { - if (previous?.[canonical] !== undefined) usage[canonical] = previous[canonical]; - if (native[field] != null) emit("session.collection_warning", { code: "invalid_usage", field }); - } + if (Object.hasOwn(native, field)) snapshot[canonical] = native[field]; + delete snapshot[field]; + } + for (const field of ["input_tokens", "output_tokens", "thinking_tokens", "cache_read_tokens", "total_tokens"]) { + if (native[field] != null && !isTokenCount(native[field])) emit("session.collection_warning", { code: "invalid_usage", field }); } - if (!Object.hasOwn(native, "input_tokens_include_cache") && ["input_tokens", "output_tokens", "reasoning_output_tokens", "cache_read_input_tokens", "total_tokens"].some(field => isTokenCount(usage[field]))) + const usage = reconcileSessionUsage(previous, snapshot); + if (usage && !Object.hasOwn(native, "input_tokens_include_cache") && ["input_tokens", "output_tokens", "reasoning_output_tokens", "cache_read_input_tokens", "total_tokens"].some(field => isTokenCount(usage[field]))) usage.input_tokens_include_cache = false; return usage; } diff --git a/actions/setup/js/parse_agy_log_conformance.test.cjs b/actions/setup/js/parse_agy_log_conformance.test.cjs index 8a621a4a4d8..b8871385eae 100644 --- a/actions/setup/js/parse_agy_log_conformance.test.cjs +++ b/actions/setup/js/parse_agy_log_conformance.test.cjs @@ -5,7 +5,7 @@ import path from "node:path"; import { parseAgyLog } from "./parse_agy_log.cjs"; import { collectUnifiedSession, parseEngineSession } from "./unified_session.cjs"; import { writeSessionArtifact } from "./session_artifact.cjs"; -import { agySmoke } from "./fixtures/agy_ci_sessions.cjs"; +import { agySmoke, agyAccounting, agyLegacySummary } from "./fixtures/agy_ci_sessions.cjs"; import { validateSession } from "./scripts/validate_session.cjs"; const jsonl = records => records.map(record => JSON.stringify(record)).join("\n") + "\n"; @@ -13,6 +13,23 @@ const roots = []; afterEach(() => roots.splice(0).forEach(root => fs.rmSync(root, { recursive: true, force: true }))); describe("run-backed AGY canonical session", () => { + it("reconciles all observed step accounting with the native terminal, not the appended legacy summary", () => { + const terminal = agySmoke.at(-1); + const records = [agySmoke[0], ...agyAccounting, terminal, agyLegacySummary]; + const events = parseAgyLog(jsonl(records)).logEntries; + const reports = events.filter(event => event.type === "usage.report"); + expect(reports).toHaveLength(17); + const result = events.find(event => event.type === "session.result"); + for (const field of ["input_tokens", "output_tokens", "reasoning_output_tokens", "cache_read_input_tokens", "total_tokens"]) { + expect(reports.reduce((sum, report) => sum + report.data.usage[field], 0)).toBe(result.data.usage[field]); + } + expect(result.data.usage).toMatchObject({ input_tokens: 79491, cache_read_input_tokens: 298918, input_tokens_include_cache: false }); + expect(events.filter(event => event.type === "session.result")).toHaveLength(1); + expect(events.filter(event => event.type === "session.collection_warning")).toEqual([]); + expect(parseAgyLog(jsonl(events)).logEntries).toEqual(events); + expect(validateSession(jsonl(events), "agent")).toBe(events.length); + }); + it("maps observed initialization, contentless messages, outputless completions and per-step accounting", () => { const events = parseAgyLog(jsonl(agySmoke)).logEntries; expect(events.find(event => event.type === "session.init").data).toMatchObject({ @@ -69,6 +86,25 @@ describe("run-backed AGY canonical session", () => { }); describe("AGY source-dependent observations (synthetic edge cases)", () => { + it("uses shared cumulative reconciliation for canonical usage additions and explicit overflow", () => { + const records = [ + { event: "result", result: { status: "SUCCESS", usage: { input_tokens: 10, thinking_tokens: 2, cache_read_tokens: 4, cache_creation_input_tokens: 1, billing: { measured: true } } } }, + { event: "result", result: { status: "ERROR", usage: { reasoning_output_tokens: 3, cache_creation_input_tokens: 2, overflowed_tokens: ["input_tokens"] } } }, + ]; + const events = parseAgyLog(jsonl(records)).logEntries; + const result = events.find(event => event.type === "session.result"); + expect(result.data.usage).toEqual({ + reasoning_output_tokens: 3, + cache_read_input_tokens: 4, + cache_creation_input_tokens: 2, + billing: { measured: true }, + input_tokens_include_cache: false, + overflowed_tokens: ["input_tokens"], + }); + expect(result.data.nativeSnapshots).toEqual([records[0]]); + expect(validateSession(jsonl(events), "agent")).toBe(events.length); + }); + it("preserves native identities, empty content, user/reasoning channels and unknown extensions", () => { const records = [ { event: "user", id: "user-native", parentId: null, timestamp: 0, message: { content: [{ type: "text", text: " prompt\n" }] } }, From 573bb5f72de5c51250da96d0d870d7cb8223ba3c Mon Sep 17 00:00:00 2001 From: Peli de Halleux Date: Sun, 11 Oct 2026 09:40:48 -0700 Subject: [PATCH 4/5] fix: resolve CGO Aider attribution and generated skill failures (#67751) --- .github/skills/agentic-workflows/SKILL.md | 1 + .github/workflows/daily-code-debt-aider.lock.yml | 4 ++-- .github/workflows/daily-go-test-stubs-aider.lock.yml | 4 ++-- .github/workflows/engine-conformance-aider.lock.yml | 4 ++-- .github/workflows/shared/aider.md | 2 +- .github/workflows/smoke-aider.lock.yml | 4 ++-- ...capture-aider-native-session-evidence-via-runtime-hooks.md | 2 +- pkg/cli/data/agentic_workflows_fallback_aw_files.json | 1 + 8 files changed, 12 insertions(+), 10 deletions(-) diff --git a/.github/skills/agentic-workflows/SKILL.md b/.github/skills/agentic-workflows/SKILL.md index 3d9700c7f54..dc827807267 100644 --- a/.github/skills/agentic-workflows/SKILL.md +++ b/.github/skills/agentic-workflows/SKILL.md @@ -47,6 +47,7 @@ Load these files from `github/gh-aw` (they are not available locally). - `.github/aw/instructions.md` - `.github/aw/intent.md` - `.github/aw/jobs.md` +- `.github/aw/ledger.md` - `.github/aw/linter-workflows.md` - `.github/aw/llms.md` - `.github/aw/loop.md` diff --git a/.github/workflows/daily-code-debt-aider.lock.yml b/.github/workflows/daily-code-debt-aider.lock.yml index 215e67212c2..41475f8ea50 100644 --- a/.github/workflows/daily-code-debt-aider.lock.yml +++ b/.github/workflows/daily-code-debt-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"87ea2155e4df859269fb1b9dbdda93dbb628c5f17e612f7db9f24ce1732ad963","body_hash":"7b39053084c924dcdd876e1a211d1927477965fc6f51da48e3dbfa5316ee328b","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"9a527c7ea8cdd2d4d7ed2ab9d540613078db4242a66c419d7ecfec4a81a7f587","body_hash":"7b39053084c924dcdd876e1a211d1927477965fc6f51da48e3dbfa5316ee328b","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_CI_TRIGGER_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_pull_request","missing_data","missing_tool","noop","report_incomplete"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1029,7 +1029,7 @@ jobs: const interpretedTypes = new Set([ "session.init", "session.start", "session.info", "session.shutdown", "session.task_complete", "user.message", - "assistant.message", "assistant.message_delta", + "assistant.message", "assistant.message_delta", "assistant.message_update", "assistant.reasoning", "assistant.reasoning_delta", "assistant.refusal", "assistant.usage", "assistant.turn_end", "model.call_failure", "tool.execution_start", "tool.execution_update", "tool.execution_complete", diff --git a/.github/workflows/daily-go-test-stubs-aider.lock.yml b/.github/workflows/daily-go-test-stubs-aider.lock.yml index a53b56bd188..512a86b232d 100644 --- a/.github/workflows/daily-go-test-stubs-aider.lock.yml +++ b/.github/workflows/daily-go-test-stubs-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"af8325aabf8dcbb0efbfaf31f082b00591fa492d3354ad00d1b3f1478b793059","body_hash":"99eb80ec2bce3938e2af26781db1b953a94cbe316d91805fc07cde14c6ecd1b9","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"d724f1382f7aa081f45be8be72c8136d18dbd78c922e8adba04d5075050c1c08","body_hash":"99eb80ec2bce3938e2af26781db1b953a94cbe316d91805fc07cde14c6ecd1b9","strict":true,"agent_id":"aider","agent_model":"copilot/auto","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_CI_TRIGGER_TOKEN","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GH_AW_OTEL_GRAFANA_AUTHORIZATION","GH_AW_OTEL_GRAFANA_ENDPOINT","GH_AW_OTEL_SENTRY_AUTHORIZATION","GH_AW_OTEL_SENTRY_ENDPOINT","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"safeoutputs","tools":["create_pull_request","missing_data","missing_tool","noop","report_incomplete"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1029,7 +1029,7 @@ jobs: const interpretedTypes = new Set([ "session.init", "session.start", "session.info", "session.shutdown", "session.task_complete", "user.message", - "assistant.message", "assistant.message_delta", + "assistant.message", "assistant.message_delta", "assistant.message_update", "assistant.reasoning", "assistant.reasoning_delta", "assistant.refusal", "assistant.usage", "assistant.turn_end", "model.call_failure", "tool.execution_start", "tool.execution_update", "tool.execution_complete", diff --git a/.github/workflows/engine-conformance-aider.lock.yml b/.github/workflows/engine-conformance-aider.lock.yml index 00efeb181be..c4e3521ba26 100644 --- a/.github/workflows/engine-conformance-aider.lock.yml +++ b/.github/workflows/engine-conformance-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"8860d1d9147dd1e2dd3b6f2b4500424b3863e41b08c116943285b3db8eb677a8","body_hash":"07595cb78705e3076f05c86c91a3ac8249cbe4915b41a419acd31b5ec956ca36","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"a226aa964176a1180f1513e46a2071f71febb2530095c905e655bf5dbe3687b5","body_hash":"07595cb78705e3076f05c86c91a3ac8249cbe4915b41a419acd31b5ec956ca36","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"mcp_servers":[{"name":"mcpscripts","tools":["conformance-challenge"]},{"name":"safeoutputs","tools":["create_issue","missing_data","missing_tool","noop","report_incomplete"]},{"name":"work-queue","tools":["work_queue_claim_finish","work_queue_dispatch_next","work_queue_explain","work_queue_read","work_queue_submit"]}],"threat_detection":{"mode":"disabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1173,7 +1173,7 @@ jobs: const interpretedTypes = new Set([ "session.init", "session.start", "session.info", "session.shutdown", "session.task_complete", "user.message", - "assistant.message", "assistant.message_delta", + "assistant.message", "assistant.message_delta", "assistant.message_update", "assistant.reasoning", "assistant.reasoning_delta", "assistant.refusal", "assistant.usage", "assistant.turn_end", "model.call_failure", "tool.execution_start", "tool.execution_update", "tool.execution_complete", diff --git a/.github/workflows/shared/aider.md b/.github/workflows/shared/aider.md index 44cb45305f7..1040d3d7ca8 100644 --- a/.github/workflows/shared/aider.md +++ b/.github/workflows/shared/aider.md @@ -400,7 +400,7 @@ engine: const interpretedTypes = new Set([ "session.init", "session.start", "session.info", "session.shutdown", "session.task_complete", "user.message", - "assistant.message", "assistant.message_delta", + "assistant.message", "assistant.message_delta", "assistant.message_update", "assistant.reasoning", "assistant.reasoning_delta", "assistant.refusal", "assistant.usage", "assistant.turn_end", "model.call_failure", "tool.execution_start", "tool.execution_update", "tool.execution_complete", diff --git a/.github/workflows/smoke-aider.lock.yml b/.github/workflows/smoke-aider.lock.yml index 8182fec1bd8..286df1900a3 100644 --- a/.github/workflows/smoke-aider.lock.yml +++ b/.github/workflows/smoke-aider.lock.yml @@ -1,4 +1,4 @@ -# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"d7c776ac47c9d3f3cf76a0feff5caff8ae9cd63971ca586cc0fd9d2bc10896e8","body_hash":"0974965a5c4bf509abd6408788f035d628d5ab213a7411ade6394d8383edd918","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} +# gh-aw-metadata: {"schema_version":"v4","frontmatter_hash":"a513ffdba3e4328c12060021d591ec0c1cbbb870127dfa194b025ffd7d373d5c","body_hash":"0974965a5c4bf509abd6408788f035d628d5ab213a7411ade6394d8383edd918","strict":true,"agent_id":"aider","agent_model":"copilot/gpt-5.4","engine_versions":{"aider":"0.86.2"}} # gh-aw-manifest: {"version":1,"secrets":["GH_AW_DEFAULT_OTLP_ENDPOINT","GH_AW_DEFAULT_OTLP_HEADERS","GH_AW_GITHUB_MCP_SERVER_TOKEN","GH_AW_GITHUB_TOKEN","GITHUB_TOKEN"],"actions":[{"repo":"actions/checkout","sha":"3d3c42e5aac5ba805825da76410c181273ba90b1","version":"v7.0.1"},{"repo":"actions/download-artifact","sha":"9000827ccba6bdab643e8b6fd33ac0654aef8333","version":"v8.0.2"},{"repo":"actions/github-script","sha":"3a2844b7e9c422d3c10d287c895573f7108da1b3","version":"v9.0.0"},{"repo":"actions/setup-node","sha":"949feb2413d6458794dcd2491c4babbbce0c15c1","version":"v7.1.0"},{"repo":"actions/setup-python","sha":"5fda3b95a4ea91299a34e894583c3862153e4b97","version":"v7.0.0"},{"repo":"actions/upload-artifact","sha":"cf430e030ddbb5b0abf93d22962f4752f3646cd9","version":"v7.0.2"}],"containers":[{"image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50","digest":"sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620","pinned_image":"ghcr.io/github/gh-aw-firewall/agent:0.28.50@sha256:91fe4af8373c723d4d2e0706a0c35d310c2eeadaea5e0738c725b3861042f620"},{"image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50","digest":"sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965","pinned_image":"ghcr.io/github/gh-aw-firewall/api-proxy:0.28.50@sha256:11f12bcd3dde377ba822df7c670d6b937e9e0cebc46218946d4edc972d7fd965"},{"image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50","digest":"sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce","pinned_image":"ghcr.io/github/gh-aw-firewall/cli-proxy:0.28.50@sha256:afa9c2c1ef66009ab88eee8af0dd43a31b6cc5a481a990d0b1b93ebda4f744ce"},{"image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50","digest":"sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9","pinned_image":"ghcr.io/github/gh-aw-firewall/squid:0.28.50@sha256:cc9b6b979edf4aafbb3811c2bdc4891039d5346473afa88e304aa692167004f9"},{"image":"ghcr.io/github/gh-aw-mcpg:v0.4.30","digest":"sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba","pinned_image":"ghcr.io/github/gh-aw-mcpg:v0.4.30@sha256:ab5a436a1490438db473e4e3d4c973cb1d75e3cb233fb08b73d31b42d7d18fba"},{"image":"ghcr.io/github/gh-aw-node","digest":"sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f","pinned_image":"ghcr.io/github/gh-aw-node@sha256:11c2c544876cdbaffefe0f7f1283b74838c209654b4934a78e23ed11f750490f"},{"image":"ghcr.io/github/github-mcp-server:v1.12.2","digest":"sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6","pinned_image":"ghcr.io/github/github-mcp-server:v1.12.2@sha256:508a0857ec762b1ab1cece29193345b501fab1dd9d1228a7b617062954cecac6"}],"has_pull_request":true,"mcp_servers":[{"name":"safeoutputs","tools":["add_comment","add_labels","create_issue","missing_data","missing_tool","noop","report_incomplete"]}],"threat_detection":{"mode":"enabled"}} # This file was automatically generated by gh-aw. DO NOT EDIT. To debug this workflow, load the skill at https://github.com/github/gh-aw/blob/main/debug.md # @@ -1120,7 +1120,7 @@ jobs: const interpretedTypes = new Set([ "session.init", "session.start", "session.info", "session.shutdown", "session.task_complete", "user.message", - "assistant.message", "assistant.message_delta", + "assistant.message", "assistant.message_delta", "assistant.message_update", "assistant.reasoning", "assistant.reasoning_delta", "assistant.refusal", "assistant.usage", "assistant.turn_end", "model.call_failure", "tool.execution_start", "tool.execution_update", "tool.execution_complete", diff --git a/docs/adr/67395-capture-aider-native-session-evidence-via-runtime-hooks.md b/docs/adr/67395-capture-aider-native-session-evidence-via-runtime-hooks.md index 89c29acd275..23a9faeb9a7 100644 --- a/docs/adr/67395-capture-aider-native-session-evidence-via-runtime-hooks.md +++ b/docs/adr/67395-capture-aider-native-session-evidence-via-runtime-hooks.md @@ -14,7 +14,7 @@ The Aider engine adapter in `.github/workflows/shared/aider.md` builds an inline We will capture Aider session evidence from Aider's **native runtime objects** by monkey-patching `Coder.show_send_output` and `Coder.calculate_and_show_tokens_and_cost` inside the workflow entrypoint, instead of inferring it from formatted terminal output. The hook reads the raw completion (`choices[].message.content`, `reasoning_content`/`reasoning`, `refusal`, `finish_reason`, `id`, `model`, `created`, `usage`) and emits distinct `assistant.message`, `assistant.reasoning` and `assistant.refusal` events, preserving empty/null/false/zero values verbatim; `assistant_output` is suppressed while a hooked response is being rendered so the display path no longer duplicates provider text. Observed per-response usage is normalised into the canonical accounting schema and summed into a single terminal `session.result`, and one native cost snapshot is published only when Aider itself reports a priced model. We will also prefer the engine's declared parser in shared dispatch and recover attributable historical startup failures from raw logs as `session.error` entries, without fabricating counts, identifiers, conversation content or terminal success. -Refusal-bearing and content-filtered responses emit `assistant.refusal` instead of an `assistant.message` answer. Events interpreted by downstream session, workflow, and guardrail consumers require explicit `sourceEngine: "aider"` attribution because shell stdout shares the log stream; this includes snapshots used for model selection and deltas rendered as assistant text or reasoning. Only opaque unknown extension types may remain source-less. Empty-output engine attribution uses runner metadata or the configured engine, not agent-produced `workflow.info` events. Empty display-layer warning calls do not create assistant messages or increment turns; explicitly observed empty provider replies remain preserved. +Refusal-bearing and content-filtered responses emit `assistant.refusal` instead of an `assistant.message` answer. Events interpreted by downstream session, workflow, and guardrail consumers require explicit `sourceEngine: "aider"` attribution because shell stdout shares the log stream; this includes snapshots used for model selection, `assistant.message_update` events, and deltas rendered as assistant text or reasoning. Only opaque unknown extension types may remain source-less. Empty-output engine attribution uses runner metadata or the configured engine, not agent-produced `workflow.info` events. Empty display-layer warning calls do not create assistant messages or increment turns; explicitly observed empty provider replies remain preserved. ### Alternatives Considered diff --git a/pkg/cli/data/agentic_workflows_fallback_aw_files.json b/pkg/cli/data/agentic_workflows_fallback_aw_files.json index 5d776f818ef..7440de69535 100644 --- a/pkg/cli/data/agentic_workflows_fallback_aw_files.json +++ b/pkg/cli/data/agentic_workflows_fallback_aw_files.json @@ -31,6 +31,7 @@ "instructions.md", "intent.md", "jobs.md", + "ledger.md", "linter-workflows.md", "llms.md", "loop.md", From 1314d4252ee6a65ab94a049ab9978cc91e8da990 Mon Sep 17 00:00:00 2001 From: Peli de Halleux Date: Sun, 11 Oct 2026 09:54:01 -0700 Subject: [PATCH 5/5] Preserve grader and eval attribution in unified sessions (#67748) Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> --- actions/setup/js/types/unified_session.d.ts | 32 ++++++- actions/setup/js/unified_session.cjs | 4 +- actions/setup/js/unified_session.test.cjs | 30 +++++++ actions/setup/js/unified_session_payload.cjs | 23 ++++- .../setup/js/unified_session_payload.test.cjs | 60 +++++++++++++ .../schemas/unified-session.schema.json | 84 ++++++++++++++++++- .../unified-agent-session-specification.md | 4 +- 7 files changed, 224 insertions(+), 13 deletions(-) diff --git a/actions/setup/js/types/unified_session.d.ts b/actions/setup/js/types/unified_session.d.ts index 754d7372eda..e273ad479f2 100644 --- a/actions/setup/js/types/unified_session.d.ts +++ b/actions/setup/js/types/unified_session.d.ts @@ -254,14 +254,40 @@ export interface GraderData { direction?: JsonValue; threshold?: JsonValue; error?: JsonValue; + source?: JsonValue; + enabled?: JsonValue; + min?: JsonValue; + max?: JsonValue; + digest?: JsonValue; + severity?: JsonValue; + message?: JsonValue; } export interface GraderManifestData { + version?: JsonValue; graders?: GraderData[]; } -export interface GraderResultData extends GraderData { - results?: GraderData[]; +export interface GraderMeasurementData extends GraderData { + implementation?: { + id?: JsonValue; + version?: JsonValue; + digest?: JsonValue; + } | null; + metrics?: { id?: JsonValue; value?: JsonValue }[]; +} + +export interface GraderResultData extends GraderMeasurementData { + version?: JsonValue; + run?: { + id?: JsonValue; + attempt?: JsonValue; + graderCount?: JsonValue; + passed?: JsonValue; + failed?: JsonValue; + errors?: JsonValue; + } | null; + results?: GraderMeasurementData[]; } export interface EvalResultData { @@ -269,6 +295,8 @@ export interface EvalResultData { answer?: JsonValue; model?: JsonValue; error?: JsonValue; + runId?: JsonValue; + assignments?: JsonValue; } export interface ExecutionResultData { diff --git a/actions/setup/js/unified_session.cjs b/actions/setup/js/unified_session.cjs index 7888d5ffa77..b1d7ba9d23b 100644 --- a/actions/setup/js/unified_session.cjs +++ b/actions/setup/js/unified_session.cjs @@ -449,11 +449,11 @@ function collectUnifiedSession({ rootDir = "/tmp/gh-aw", engine, warn = message [["experiments/assignments.json", "usage/experiment/assignments.json"], "experiment", "activation", "experiment.assignment"], [["agent/graders/grader_manifest.json", "usage/graders/grader_manifest.json"], "grader", "agent", "grader.manifest"], [["agent/graders/grader_results.json", "usage/graders/grader_results.json"], "grader", "agent", "grader.result"], - [["evals/evals.jsonl", "usage/evals.jsonl"], "eval", "evals", "eval.result"], + [["evals/evals.jsonl", "evals.jsonl", "usage/evals.jsonl"], "eval", "evals", "eval.result"], [["agent_usage.jsonl", "usage/agent_usage.jsonl"], "usage", "agent", "usage.report"], [["github_rate_limits.jsonl", "usage/github_rate_limits.jsonl"], "github_api", "workflow", "github_api.rate_limit"], [["threat-detection/detection_usage.jsonl", "detection_usage.jsonl", "usage/detection_usage.jsonl"], "usage", "detection", "usage.report"], - [["evals/evals_token_usage.jsonl", "usage/evals/token_usage.jsonl"], "usage", "evals", "usage.report"], + [["evals/evals_token_usage.jsonl", "evals_token_usage.jsonl", "usage/evals/token_usage.jsonl"], "usage", "evals", "usage.report"], [["agent_execution.json", "usage/agent/execution.json"], "execution", "agent", "execution.result"], [["threat-detection/execution.json", "usage/detection/execution.json"], "execution", "detection", "execution.result"], [["evals/evals/execution.json", "evals/execution.json", "usage/evals/execution.json"], "execution", "evals", "execution.result"], diff --git a/actions/setup/js/unified_session.test.cjs b/actions/setup/js/unified_session.test.cjs index 6973ba5cf02..5e00d62bf6c 100644 --- a/actions/setup/js/unified_session.test.cjs +++ b/actions/setup/js/unified_session.test.cjs @@ -38,6 +38,36 @@ describe("Unified conclusion session", () => { return target; } + it.each(["evals-job", "conclusion", "usage-only"])("persists grader and eval evidence from the %s layout exactly once", layout => { + const gradersDir = layout === "usage-only" ? "usage/graders" : "agent/graders"; + const evalsPath = layout === "evals-job" ? "evals.jsonl" : layout === "conclusion" ? "evals/evals.jsonl" : "usage/evals.jsonl"; + const tokenPath = layout === "evals-job" ? "evals_token_usage.jsonl" : layout === "conclusion" ? "evals/evals_token_usage.jsonl" : "usage/evals/token_usage.jsonl"; + const manifest = { version: 1, graders: [{ id: "coverage", enabled: true, source: "builtin", threshold: 0 }] }; + const result = { id: "coverage", status: "unavailable", value: null, passed: null, source: "builtin", message: "No evidence", implementation: { id: "gh-aw/graders", version: 1 } }; + const run = { id: "123", attempt: 2, graderCount: 1, passed: 0, failed: 0, errors: 0 }; + write(`${gradersDir}/grader_manifest.json`, manifest); + write(`${gradersDir}/grader_results.json`, { version: 1, run, results: [result] }); + write(evalsPath, [{ id: "quality", answer: "NO", model: "fixture", runid: "123", timestamp: "2026-10-11T00:00:00Z", question: "PRIVATE_QUESTION" }]); + write(tokenPath, [{ model: "fixture", input_tokens: 0, output_tokens: 0 }]); + if (layout !== "usage-only") { + write("usage/graders/grader_manifest.json", manifest); + write("usage/graders/grader_results.json", { results: [{ id: "stale" }] }); + write("usage/evals.jsonl", [{ id: "stale" }]); + write("usage/evals/token_usage.jsonl", [{ model: "stale" }]); + } + const events = writeUnifiedSession({ rootDir: root, dailyAIC: {} }); + expect(events.filter(event => event.type === "grader.manifest").map(event => event.data)).toEqual([manifest]); + expect(events.filter(event => event.type === "grader.result").map(event => event.data)).toEqual([{ version: 1, run, results: [result] }]); + expect(events.filter(event => event.type === "eval.result")).toMatchObject([{ data: { id: "quality", answer: "NO", model: "fixture", runId: "123" }, provenance: { phase: "evals", path: evalsPath } }]); + expect(events.filter(event => event.type === "usage.report" && event.provenance.phase === "evals")).toMatchObject([{ data: { model: "fixture", usage: { inputTokens: 0, outputTokens: 0 } }, provenance: { path: tokenPath } }]); + expect(events.at(-1).data.absentComponents).not.toContain("grader"); + expect(events.at(-1).data.absentComponents).not.toContain("eval"); + const persisted = fs.readFileSync(path.join(root, "usage/aw_session.jsonl"), "utf8"); + expect(persisted).not.toContain("PRIVATE_"); + expect(persisted).not.toContain("stale"); + expect(writeUnifiedSession({ rootDir: root, dailyAIC: {} })).toEqual(events); + }); + it.each(["startup", "runtime"])("collects a single model/endpoint mismatch record in the %s phase", phase => { const data = { category: "model_endpoint_mismatch", diff --git a/actions/setup/js/unified_session_payload.cjs b/actions/setup/js/unified_session_payload.cjs index a44628af8f6..ad83ed8d5aa 100644 --- a/actions/setup/js/unified_session_payload.cjs +++ b/actions/setup/js/unified_session_payload.cjs @@ -85,6 +85,13 @@ const GRADER_FIELDS = { direction: ["direction"], threshold: ["threshold"], error: ["error"], + source: ["source"], + enabled: ["enabled"], + min: ["min"], + max: ["max"], + digest: ["digest"], + severity: ["severity"], + message: ["message"], }; const MODEL_ROUTING_FIELDS = { status: ["status"], @@ -313,9 +320,9 @@ const EVENT_FIELDS = { "safe_output.result": SAFE_OUTPUT_FIELDS, "safe_output.error": SAFE_OUTPUT_FIELDS, "experiment.state": { runId: ["runId", "run_id"], assignments: ["assignments"], counts: ["counts"] }, - "grader.manifest": {}, + "grader.manifest": { version: ["version"] }, "grader.result": GRADER_FIELDS, - "eval.result": { id: ["id"], answer: ["answer"], model: ["model"], error: ["error"] }, + "eval.result": { id: ["id"], answer: ["answer"], model: ["model"], error: ["error"], runId: ["runId", "runid"], assignments: ["assignments", "experiments"] }, "github_api.rate_limit": { source: ["source"], credentialSource: ["credentialSource", "credential_source"], @@ -506,7 +513,17 @@ function normalizeUnifiedSessionEvent(event, phase) { data.assignments = structuredClone(source.assignments ?? source); } if (event.type === "grader.manifest" && Array.isArray(source.graders)) data.graders = source.graders.map(grader => selectFields(grader, GRADER_FIELDS)); - if (event.type === "grader.result" && Array.isArray(source.results)) data.results = source.results.map(result => selectFields(result, GRADER_FIELDS)); + if (event.type === "grader.result") { + if (source.version !== undefined) data.version = structuredClone(source.version); + if (source.run !== undefined) data.run = source.run === null ? null : selectFields(source.run, { id: ["id"], attempt: ["attempt"], graderCount: ["graderCount"], passed: ["passed"], failed: ["failed"], errors: ["errors"] }); + const projectResult = result => ({ + ...selectFields(result, GRADER_FIELDS), + ...(result?.implementation !== undefined ? { implementation: result.implementation === null ? null : selectFields(result.implementation, { id: ["id"], version: ["version"], digest: ["digest"] }) } : {}), + ...(Array.isArray(result?.metrics) ? { metrics: result.metrics.map(metric => selectFields(metric, { id: ["id"], value: ["value"] })) } : {}), + }); + Object.assign(data, projectResult(source)); + if (Array.isArray(source.results)) data.results = source.results.map(projectResult); + } if (event.type === "safe_output.error") { const errors = source.errors ?? source.failures; if (Array.isArray(errors)) data.errors = errors.map(error => (error && typeof error === "object" && !Array.isArray(error) ? selectFields(error, SAFE_OUTPUT_FIELDS) : structuredClone(error))); diff --git a/actions/setup/js/unified_session_payload.test.cjs b/actions/setup/js/unified_session_payload.test.cjs index 059b5ba4aec..42a9cc30bd6 100644 --- a/actions/setup/js/unified_session_payload.test.cjs +++ b/actions/setup/js/unified_session_payload.test.cjs @@ -14,6 +14,66 @@ import { dynamicWorkflow } from "./fixtures/claude_dynamic_workflow.cjs"; import { DYNAMIC_WORKFLOW_EVENT_TYPES } from "./dynamic_workflow_session.cjs"; describe("essential unified session payloads", () => { + it("preserves grader attribution and unavailable diagnostics without executable payloads", () => { + const result = { + id: "coverage", + source: "builtin", + status: "unavailable", + value: null, + passed: null, + message: "No trajectory evidence available", + severity: "warning", + implementation: { id: "gh-aw/graders", version: 1, digest: "", script: "PRIVATE_SCRIPT" }, + metrics: [{ id: "observed", value: 0, trace: "PRIVATE_TRACE" }], + diagnostics: { private: "PRIVATE_DIAGNOSTICS" }, + script: "PRIVATE_SCRIPT", + }; + const manifest = { version: 1, graders: [{ id: "coverage", source: "builtin", enabled: false, min: 0, max: 1, digest: "", script: "PRIVATE_SCRIPT" }] }; + const run = { id: "123", attempt: 2, graderCount: 1, passed: 0, failed: 0, errors: 0 }; + const records = [ + { type: "grader.manifest", data: manifest }, + { type: "grader.result", data: { version: 1, run: { ...run, script: "PRIVATE_SCRIPT" }, results: [result] } }, + { type: "grader.result", data: { ...result, implementation: null, metrics: [] } }, + { type: "grader.result", data: { run: null, results: [] } }, + ]; + const original = structuredClone(records); + const unified = mergeSessionSources([{ component: "grader", phase: "agent", path: "agent/graders/grader_results.json", events: records }]); + expect(unified[0].data).toEqual({ version: 1, graders: [{ id: "coverage", source: "builtin", enabled: false, min: 0, max: 1, digest: "" }] }); + const expected = { + id: "coverage", + source: "builtin", + status: "unavailable", + value: null, + passed: null, + message: result.message, + severity: "warning", + implementation: { id: "gh-aw/graders", version: 1, digest: "" }, + metrics: [{ id: "observed", value: 0 }], + }; + expect(unified[1].data).toEqual({ version: 1, run, results: [expected] }); + expect(unified[2].data).toEqual({ ...expected, implementation: null, metrics: [] }); + expect(unified[3].data).toEqual({ run: null, results: [] }); + const validate = createSessionValidator("unified").event; + for (const event of unified) { + expect(normalizeUnifiedSessionEvent(event).data).toEqual(event.data); + expect(validate(event), JSON.stringify(validate.errors)).toBe(true); + } + expect(JSON.stringify(unified)).not.toContain("PRIVATE_"); + expect(records).toEqual(original); + }); + + it("preserves eval run and experiment attribution without evaluation questions", () => { + const assignments = { variant: { value: "baseline" } }; + const source = { type: "eval.result", timestamp: "2026-10-11T00:00:00Z", data: { id: "quality", answer: "UNKNOWN", model: "fixture", runid: "123", experiments: assignments, question: "PRIVATE_QUESTION" } }; + const original = structuredClone(source); + const event = normalizeUnifiedSessionEvent(source); + expect(event).toEqual({ type: source.type, timestamp: source.timestamp, data: { id: "quality", answer: "UNKNOWN", model: "fixture", runId: "123", assignments } }); + expect(normalizeUnifiedSessionEvent(event)).toEqual(event); + const [unified] = mergeSessionSources([{ component: "eval", phase: "evals", path: "evals/evals.jsonl", events: [source] }]); + expect(createSessionValidator("unified").event(unified)).toBe(true); + expect(source).toEqual(original); + }); + it.each([true, false])("retains final model result and BYOK=%s through persisted unified projection", isByok => { const source = { type: "model.call_final_result", diff --git a/docs/public/schemas/unified-session.schema.json b/docs/public/schemas/unified-session.schema.json index e5d99c2168f..a83bdb6e797 100644 --- a/docs/public/schemas/unified-session.schema.json +++ b/docs/public/schemas/unified-session.schema.json @@ -512,7 +512,14 @@ }, "EvalResultData": { "type": "object", - "properties": { "id": { "$ref": "#/definitions/JsonValue" }, "answer": { "$ref": "#/definitions/JsonValue" }, "model": { "$ref": "#/definitions/JsonValue" }, "error": { "$ref": "#/definitions/JsonValue" } }, + "properties": { + "id": { "$ref": "#/definitions/JsonValue" }, + "answer": { "$ref": "#/definitions/JsonValue" }, + "model": { "$ref": "#/definitions/JsonValue" }, + "error": { "$ref": "#/definitions/JsonValue" }, + "runId": { "$ref": "#/definitions/JsonValue" }, + "assignments": { "$ref": "#/definitions/JsonValue" } + }, "additionalProperties": false }, "EventMetadata": { "type": "object", "properties": { "id": { "type": "string" }, "parentId": { "type": ["string", "null"] }, "timestamp": { "type": ["string", "number"] } }, "additionalProperties": {} }, @@ -575,11 +582,48 @@ "passed": { "$ref": "#/definitions/JsonValue" }, "direction": { "$ref": "#/definitions/JsonValue" }, "threshold": { "$ref": "#/definitions/JsonValue" }, - "error": { "$ref": "#/definitions/JsonValue" } + "error": { "$ref": "#/definitions/JsonValue" }, + "source": { "$ref": "#/definitions/JsonValue" }, + "enabled": { "$ref": "#/definitions/JsonValue" }, + "min": { "$ref": "#/definitions/JsonValue" }, + "max": { "$ref": "#/definitions/JsonValue" }, + "digest": { "$ref": "#/definitions/JsonValue" }, + "severity": { "$ref": "#/definitions/JsonValue" }, + "message": { "$ref": "#/definitions/JsonValue" } + }, + "additionalProperties": false + }, + "GraderManifestData": { "type": "object", "properties": { "version": { "$ref": "#/definitions/JsonValue" }, "graders": { "type": "array", "items": { "$ref": "#/definitions/GraderData" } } }, "additionalProperties": false }, + "GraderMeasurementData": { + "type": "object", + "properties": { + "id": { "$ref": "#/definitions/JsonValue" }, + "name": { "$ref": "#/definitions/JsonValue" }, + "status": { "$ref": "#/definitions/JsonValue" }, + "value": { "$ref": "#/definitions/JsonValue" }, + "score": { "$ref": "#/definitions/JsonValue" }, + "unit": { "$ref": "#/definitions/JsonValue" }, + "passed": { "$ref": "#/definitions/JsonValue" }, + "direction": { "$ref": "#/definitions/JsonValue" }, + "threshold": { "$ref": "#/definitions/JsonValue" }, + "error": { "$ref": "#/definitions/JsonValue" }, + "source": { "$ref": "#/definitions/JsonValue" }, + "enabled": { "$ref": "#/definitions/JsonValue" }, + "min": { "$ref": "#/definitions/JsonValue" }, + "max": { "$ref": "#/definitions/JsonValue" }, + "digest": { "$ref": "#/definitions/JsonValue" }, + "severity": { "$ref": "#/definitions/JsonValue" }, + "message": { "$ref": "#/definitions/JsonValue" }, + "implementation": { + "anyOf": [ + { "type": "object", "properties": { "id": { "$ref": "#/definitions/JsonValue" }, "version": { "$ref": "#/definitions/JsonValue" }, "digest": { "$ref": "#/definitions/JsonValue" } }, "additionalProperties": false }, + { "type": "null" } + ] + }, + "metrics": { "type": "array", "items": { "type": "object", "properties": { "id": { "$ref": "#/definitions/JsonValue" }, "value": { "$ref": "#/definitions/JsonValue" } }, "additionalProperties": false } } }, "additionalProperties": false }, - "GraderManifestData": { "type": "object", "properties": { "graders": { "type": "array", "items": { "$ref": "#/definitions/GraderData" } } }, "additionalProperties": false }, "GraderResultData": { "type": "object", "properties": { @@ -593,7 +637,39 @@ "direction": { "$ref": "#/definitions/JsonValue" }, "threshold": { "$ref": "#/definitions/JsonValue" }, "error": { "$ref": "#/definitions/JsonValue" }, - "results": { "type": "array", "items": { "$ref": "#/definitions/GraderData" } } + "source": { "$ref": "#/definitions/JsonValue" }, + "enabled": { "$ref": "#/definitions/JsonValue" }, + "min": { "$ref": "#/definitions/JsonValue" }, + "max": { "$ref": "#/definitions/JsonValue" }, + "digest": { "$ref": "#/definitions/JsonValue" }, + "severity": { "$ref": "#/definitions/JsonValue" }, + "message": { "$ref": "#/definitions/JsonValue" }, + "implementation": { + "anyOf": [ + { "type": "object", "properties": { "id": { "$ref": "#/definitions/JsonValue" }, "version": { "$ref": "#/definitions/JsonValue" }, "digest": { "$ref": "#/definitions/JsonValue" } }, "additionalProperties": false }, + { "type": "null" } + ] + }, + "metrics": { "type": "array", "items": { "type": "object", "properties": { "id": { "$ref": "#/definitions/JsonValue" }, "value": { "$ref": "#/definitions/JsonValue" } }, "additionalProperties": false } }, + "version": { "$ref": "#/definitions/JsonValue" }, + "run": { + "anyOf": [ + { + "type": "object", + "properties": { + "id": { "$ref": "#/definitions/JsonValue" }, + "attempt": { "$ref": "#/definitions/JsonValue" }, + "graderCount": { "$ref": "#/definitions/JsonValue" }, + "passed": { "$ref": "#/definitions/JsonValue" }, + "failed": { "$ref": "#/definitions/JsonValue" }, + "errors": { "$ref": "#/definitions/JsonValue" } + }, + "additionalProperties": false + }, + { "type": "null" } + ] + }, + "results": { "type": "array", "items": { "$ref": "#/definitions/GraderMeasurementData" } } }, "additionalProperties": false }, diff --git a/docs/src/content/docs/specs/unified-agent-session-specification.md b/docs/src/content/docs/specs/unified-agent-session-specification.md index b8904c4b66d..c7ea0a857ac 100644 --- a/docs/src/content/docs/specs/unified-agent-session-specification.md +++ b/docs/src/content/docs/specs/unified-agent-session-specification.md @@ -244,7 +244,7 @@ opaque because its essential fields are not defined by this specification. | Firewall | Host, method, status, decision, byte count, duration; steering/tracker event, level, message, reason, and request ID. | | Safe outputs | Operation type, repository/number, provider/identifier/URL, status, and errors; no requested title/body or arbitrary operation payload. | | Experiments | Run ID, assignments, and counts. | -| Graders and evals | Grader IDs/names, values, units, statuses, decisions, thresholds, and errors; eval ID, answer, model, and error. No grader scripts or eval questions. | +| Graders and evals | Grader IDs/names, sources, enabled flags, bounds, values, units, statuses, decisions, thresholds, errors, severity, and diagnostic messages. Manifest/result versions, run ID/attempt and counts, implementation ID/version/digest, and metric ID/value pairs are retained when supplied. Eval ID, answer, model, error, run ID, and experiment assignments are retained. No grader scripts, opaque diagnostics, or eval questions. | | Runtime accounting | Provider, model, request ID, status, AIC, cumulative/checkpoint AIC, premium requests, duration, and normalized `usage`; overlapping reports stay separate. Detection and eval usage reports resolve per-observation AIC from known model pricing only when explicit AIC is unavailable; unknown pricing leaves AIC absent, while explicit zero and checkpoints remain authoritative. | | Execution, detection, workflow | Observed outcomes, exit code, duration/start/end, detection job result/conclusion/categorical reason and verdict flags, engine ID, requested model, trigger type, workflow/repository/run ID, and available gh-aw, AWF, MCPG, and agent versions. No detector transcript or free-form reasons. | | Model routing | `firewall.model_routing` retains its stage, purpose, provider, labels, selection, endpoint, router, request, outcome, and deviation fields. `workflow.info` includes the observed `model`, `requestedModel`, and a compact `modelRouting` object. `model_routing.outcome` records the harness's status, wire model, effective and selected endpoints, effort, applied effort, and failure code. | @@ -1358,7 +1358,7 @@ timeline, and the disclosure does not repeat its title as a standalone heading. | MCPG | Method, server, RPC ID, tool name, observed responses/errors, and filter/block diagnostics. Raw RPC arguments and response bodies are omitted. | | AWF | Network host/method/status/decision, observed token usage, steering messages, and tracker event names. | | Safe outputs | Requested versus execution-recorded operations, target metadata, and structured error counts. Requests are not displayed as successes. | -| Experiments, graders, evals | Assignments/state, grader value/unit/outcome, and eval ID/answer/model. Grader scripts and raw evaluation questions are omitted. | +| Experiments, graders, evals | Assignments/state, grader value/unit/outcome, implementation identity, diagnostic messages and metrics, and eval ID/answer/model with run and experiment attribution. Grader scripts, opaque diagnostics, and raw evaluation questions are omitted. | | Execution, detection, collection | Recorded outcomes/verdict flags, detection job result/conclusion/categorical reason, source coverage, warnings, untimed counts, and absent components. No detector transcript or free-form reasons. | | Unknown extensions | Type and provenance only; opaque payloads are not dumped. |