Skip to content

Evaluate and retire the experimental runtime-log diagnostic gate #4350

Description

@devantler

🤖 Generated by the Agentic Engineer

Part of #4349. The finite runtime-log diagnostic initially requires explicit experimental opt-in so its first operator use can be evaluated before routine adoption.

By 2026-10-09, review the merged diagnostic's real sample replay and subsequent operator feedback. Decide whether to graduate and remove the temporary gate, correct the diagnostic and keep a dated follow-up, or retire it if it provides no useful evidence. Remove the temporary gate and its documentation together when graduation is justified; preserve conservative pairing, private evidence and the separation from incident attribution.

Acceptance: record the operator evaluation and decision, ship any resulting change through a reviewed PR, and leave no undated experimental gate.

Reassessed 2026-10-10: the opt-in stays. Next reassessment 2026-10-24, or when #4329 closes, whichever comes first; it ends in a change either way (see the comment of 2026-10-10).

Activity

  1. added theissue type on Oct 2, 2026
  2. moved this to 📥 Backlog in 🌊 Project Boardon Oct 2, 2026
  3. devantler commented on Oct 4, 2026

    @devantler
    ContributorAuthor

    🤖 Generated by the Agentic Engineer

    First real operator evaluation completed using a finite private capture from seven existing nodes through the existing authorized reader. Every capture succeeded, exact command and timing metadata was retained, and the node identities remained unchanged in the post-capture snapshot.

    The analyzer reports 411 completed supported pairs, including 137 returns in the requested window and 16 pairs slower than five seconds. There are no failed completed pairs or truncated samples. It correctly returns GAPS: the inputs contain malformed records, timestamp ordering gaps and ambiguous or incomplete pairs, and no stream brackets the entire requested window. These limits remain visible; successful capture is not complete request coverage.

    The known synthetic timing and conservative gap controls pass. Four reported elapsed times also match an independent nanosecond calculation. One sandbox sample can be joined through exact Pod, Job and CronJob UIDs; the other 13 sandbox samples lack a current live Pod join. This is useful bounded runtime evidence, while CorootAttribution: UNPROVEN remains correct.

    Decision: retain explicit experimental opt-in for the dated 2026-10-09 reassessment. The first real use does not yet justify routine adoption or removing the gate; independent request attribution and further operator feedback are still needed. No runtime or monitoring setting was changed, and raw logs, identities and the detailed report remain private. This issue stays open with its existing dated follow-up.

  4. added a commit that references this issue on Oct 10, 2026
  5. devantler commented on Oct 10, 2026

    @devantler
    ContributorAuthor

    🤖 Generated by the Agentic Engineer

    Reassessment due 2026-10-09, done 2026-10-10: keep the opt-in, one more dated period, then no further extensions

    What I checked

    • The diagnostic and its guide are unchanged since feat: add explicit finite CRI log diagnostics #4351 merged on 2026-10-02, and the opt-in is still required on main at a9c39fa7.
    • I found no recorded use since the first evaluation on 2026-10-04: no issue or pull request updated since 2026-10-05 mentions the tool. This is a search of the public record only; private operator notes were not consulted.
    • The incident it was built for, Identify and remediate the remaining Coroot latency incident #4329, is still open and still blocked on the same thing: no slow request can be joined to a dependency.

    Decision

    The first evaluation set two conditions for routine adoption: an independent way to attribute requests, and further operator feedback. Neither has arrived, and nothing new argues for retiring the tool either, since its one real use produced numbers that matched an independent calculation. So the opt-in stays for now and no code changes.

    Next reassessment: 2026-10-24, or when #4329 closes, whichever comes first. To stop this rolling forward, that one ends in a change either way:

    • used again and its numbers held up: remove the opt-in and its wording in the guide;
    • still unused, and no concrete next use named: retire the tool and its guide, because a diagnostic nobody reaches for during an open latency incident is not earning its upkeep.

    Nothing in production was read or changed for this note.

  6. added a commit that references this issue on Nov 3, 2026
  7. moved this from 🧊 Icebox to 🏃🏻‍♂️ In Progress in 🌊 Project Boardon Nov 3, 2026
  8. moved this from 🏃🏻‍♂️ In Progress to ✅ Done in 🌊 Project Boardon Nov 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Fields

    Priority

    None yet

    Start date

    None yet

    Target date

    None yet

    Effort

    None yet

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions