Skip to content

Three pre-existing UtilitiesCS.Test flakes block any suite-wide zero-failure gate #594

Description

@drmoisan

Summary

Three pre-existing flaky tests in UtilitiesCS.Test trip any absolute-zero-failure gate that spans all nine test assemblies. They are unrelated to, and unreachable from, QuickFiler work.

Observed repeatedly during the quickfiler-suite-determinism-foundation epic run on 2026-08-22, across many full-suite passes:

  1. A NullReferenceException in DfDeedle_COM_Tests.
  2. Two Console.Out races between concurrently executing tests.

Why this is filed

An epic child running a suite-wide zero-failure gate cannot pass it, and cannot fix these either — they sit outside its scope and outside its assembly. The established precedent is to scope a child's absolute-zero gate to the classes it owns and promote the residual flakes as their own defect rather than absorb them silently. This is that promotion.

Left unfiled, every future full-suite gate in this repository pays the same tax and each agent re-discovers the same three failures.

Acceptance Criteria

  • The DfDeedle_COM_Tests NRE is diagnosed and fixed, or the test is correctly categorized if it requires a live COM host.
  • The two Console.Out races are removed by eliminating the shared-console dependency, not by serializing the tests with a sleep or a retry.
  • A full nine-assembly run with /InIsolation and /TestCaseFilter:"TestCategory!=LiveOutlook" reports zero failures on ten consecutive runs.
  • No test is stabilized by adding a sleep, a retry, or a timing tolerance.

Activity

  1. drmoisan commented on Sep 8, 2026

    @drmoisan
    OwnerAuthor

    Consolidated into #811 on 2026-09-07 (maintainer decision: batch review residuals by blast radius). All acceptance criteria from this issue are carried in #811; this issue is closed as superseded, not as fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions