Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
235 changes: 117 additions & 118 deletions bench/suites/RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,135 +6,134 @@ runner measured it; the suite runs `--no-parallelize-within-files`, so a
file's number is its own serial cost and is what an author adding a case
to it pays.

- suites: 127
- serial total: 689.2s
- suites: 126
- serial total: 580.6s

| seconds | share | suite |
| ---: | ---: | --- |
| 154.0 | 22.4% | `tests/land-lock.bats` |
| 94.9 | 13.8% | `tests/land.bats` |
| 52.4 | 7.6% | `tests/hooks-wiring-check.bats` |
| 34.6 | 5.0% | `tests/main-watch.bats` |
| 24.4 | 3.5% | `tests/graph-check.bats` |
| 24.4 | 3.5% | `tests/hook-latency-drift.bats` |
| 22.8 | 3.3% | `tests/sbom-check.bats` |
| 20.6 | 3.0% | `tests/config-lint.bats` |
| 15.8 | 2.3% | `tests/board-diff-overlap.bats` |
| 14.9 | 2.2% | `tests/run-shape-guard.bats` |
| 10.1 | 1.5% | `tests/token-bench.bats` |
| 9.8 | 1.4% | `tests/ready-lint.bats` |
| 9.1 | 1.3% | `tests/ready-guard.bats` |
| 8.2 | 1.2% | `tests/released.bats` |
| 7.8 | 1.1% | `tests/board-sweep.bats` |
| 7.6 | 1.1% | `tests/target-race.bats` |
| 7.0 | 1.0% | `tests/lock-complete.bats` |
| 6.8 | 1.0% | `tests/replay.bats` |
| 6.4 | 0.9% | `tests/step-receipt.bats` |
| 6.3 | 0.9% | `tests/release-tracking-check.bats` |
| 6.3 | 0.9% | `tests/sbom.bats` |
| 6.2 | 0.9% | `tests/release-assets-check.bats` |
| 5.9 | 0.9% | `tests/in-progress-drain.bats` |
| 5.9 | 0.9% | `tests/mcp-allow-check.bats` |
| 4.8 | 0.7% | `tests/ready-cites-check.bats` |
| 4.6 | 0.7% | `tests/ntia-check.bats` |
| 4.5 | 0.7% | `tests/singleton.bats` |
| 4.3 | 0.6% | `tests/land-divergence.bats` |
| 4.2 | 0.6% | `tests/task-registry.bats` |
| 4.0 | 0.6% | `tests/hk-selection.bats` |
| 3.8 | 0.5% | `tests/doctor-race.bats` |
| 2.9 | 0.4% | `tests/target-ensure.bats` |
| 2.8 | 0.4% | `tests/landed-check.bats` |
| 2.8 | 0.4% | `tests/with-lock.bats` |
| 2.7 | 0.4% | `tests/claim-race-check.bats` |
| 2.6 | 0.4% | `tests/spec-ref-check.bats` |
| 2.6 | 0.4% | `tests/closing-key-check.bats` |
| 2.6 | 0.4% | `tests/suite-select.bats` |
| 2.5 | 0.4% | `tests/finding-sink-check.bats` |
| 2.4 | 0.4% | `tests/perf-record.bats` |
| 2.4 | 0.3% | `tests/install.bats` |
| 2.3 | 0.3% | `tests/unlanded-check.bats` |
| 2.0 | 0.3% | `tests/tree-clean.bats` |
| 2.0 | 0.3% | `tests/ci-slow-needed.bats` |
| 2.0 | 0.3% | `tests/claimed-keys.bats` |
| 2.0 | 0.3% | `tests/bot-issue.bats` |
| 1.9 | 0.3% | `tests/signing-posture.bats` |
| 1.9 | 0.3% | `tests/ci-tools-check.bats` |
| 1.8 | 0.3% | `tests/ready-lint-deferral.bats` |
| 1.7 | 0.3% | `tests/reclaim-census.bats` |
| 1.7 | 0.2% | `tests/alive.bats` |
| 1.5 | 0.2% | `tests/verify.bats` |
| 1.5 | 0.2% | `tests/ci-lease-precondition.bats` |
| 1.4 | 0.2% | `tests/done-check.bats` |
| 1.4 | 0.2% | `tests/spawn-census.bats` |
| 1.4 | 0.2% | `tests/deferral-check.bats` |
| 1.3 | 0.2% | `tests/install-check.bats` |
| 1.3 | 0.2% | `tests/awk-regex-check.bats` |
| 1.3 | 0.2% | `tests/linear-check.bats` |
| 1.3 | 0.2% | `tests/nonverdict-scan.bats` |
| 1.2 | 0.2% | `tests/land-divergence-assert.bats` |
| 1.2 | 0.2% | `tests/perf-assert.bats` |
| 1.1 | 0.2% | `tests/done-pr-check.bats` |
| 1.1 | 0.2% | `tests/fact-record-keying.bats` |
| 1.1 | 0.2% | `tests/release-backfill.bats` |
| 1.1 | 0.2% | `tests/module-map-check.bats` |
| 1.1 | 0.2% | `tests/duplicate-close-check.bats` |
| 1.0 | 0.1% | `tests/doctor.bats` |
| 1.0 | 0.1% | `tests/timeout-drift.bats` |
| 1.0 | 0.1% | `tests/render-cli.bats` |
| 1.0 | 0.1% | `tests/pr-unsubscribed.bats` |
| 1.0 | 0.1% | `tests/attestation-check.bats` |
| 0.9 | 0.1% | `tests/evaluator-closure-check.bats` |
| 0.9 | 0.1% | `tests/hook-matcher-check.bats` |
| 0.9 | 0.1% | `tests/lint-rego.bats` |
| 0.8 | 0.1% | `tests/sbom-binary.bats` |
| 0.8 | 0.1% | `tests/lint-deno.bats` |
| 0.8 | 0.1% | `tests/perf-compare.bats` |
| 0.8 | 0.1% | `tests/verified.bats` |
| 0.8 | 0.1% | `tests/suite-bench-check.bats` |
| 0.7 | 0.1% | `tests/mcp-timeout-budget.bats` |
| 0.7 | 0.1% | `tests/merged-pr-keys.bats` |
| 0.7 | 0.1% | `tests/mcp-attach-check.bats` |
| 0.7 | 0.1% | `tests/macos-link-check.bats` |
| 135.3 | 23.3% | `tests/land-lock.bats` |
| 79.2 | 13.6% | `tests/land.bats` |
| 45.5 | 7.8% | `tests/hooks-wiring-check.bats` |
| 34.7 | 6.0% | `tests/main-watch.bats` |
| 24.3 | 4.2% | `tests/hook-latency-drift.bats` |
| 20.6 | 3.5% | `tests/graph-check.bats` |
| 19.2 | 3.3% | `tests/sbom-check.bats` |
| 13.3 | 2.3% | `tests/board-diff-overlap.bats` |
| 12.1 | 2.1% | `tests/run-shape-guard.bats` |
| 8.4 | 1.4% | `tests/token-bench.bats` |
| 8.0 | 1.4% | `tests/ready-lint.bats` |
| 7.7 | 1.3% | `tests/ready-guard.bats` |
| 7.5 | 1.3% | `tests/target-race.bats` |
| 6.8 | 1.2% | `tests/released.bats` |
| 6.4 | 1.1% | `tests/board-sweep.bats` |
| 5.9 | 1.0% | `tests/lock-complete.bats` |
| 5.5 | 0.9% | `tests/release-tracking-check.bats` |
| 5.5 | 0.9% | `tests/replay.bats` |
| 5.4 | 0.9% | `tests/in-progress-drain.bats` |
| 5.4 | 0.9% | `tests/step-receipt.bats` |
| 5.1 | 0.9% | `tests/release-assets-check.bats` |
| 5.1 | 0.9% | `tests/sbom.bats` |
| 5.0 | 0.9% | `tests/singleton.bats` |
| 5.0 | 0.9% | `tests/mcp-allow-check.bats` |
| 4.0 | 0.7% | `tests/task-registry.bats` |
| 3.8 | 0.7% | `tests/ready-cites-check.bats` |
| 3.6 | 0.6% | `tests/land-divergence.bats` |
| 3.6 | 0.6% | `tests/doctor-race.bats` |
| 3.5 | 0.6% | `tests/with-lock.bats` |
| 3.4 | 0.6% | `tests/ntia-check.bats` |
| 3.2 | 0.6% | `tests/hk-selection.bats` |
| 2.6 | 0.5% | `tests/target-ensure.bats` |
| 2.6 | 0.4% | `tests/landed-check.bats` |
| 2.4 | 0.4% | `tests/suite-select.bats` |
| 2.3 | 0.4% | `tests/claim-race-check.bats` |
| 2.2 | 0.4% | `tests/spec-ref-check.bats` |
| 2.1 | 0.4% | `tests/closing-key-check.bats` |
| 2.0 | 0.3% | `tests/install.bats` |
| 2.0 | 0.3% | `tests/unlanded-check.bats` |
| 1.9 | 0.3% | `tests/finding-sink-check.bats` |
| 1.7 | 0.3% | `tests/ci-slow-needed.bats` |
| 1.7 | 0.3% | `tests/tree-clean.bats` |
| 1.7 | 0.3% | `tests/signing-posture.bats` |
| 1.6 | 0.3% | `tests/reclaim-census.bats` |
| 1.6 | 0.3% | `tests/bot-issue.bats` |
| 1.5 | 0.3% | `tests/lint-deno.bats` |
| 1.5 | 0.3% | `tests/claimed-keys.bats` |
| 1.5 | 0.3% | `tests/alive.bats` |
| 1.4 | 0.2% | `tests/ci-tools-check.bats` |
| 1.4 | 0.2% | `tests/perf-record.bats` |
| 1.4 | 0.2% | `tests/ready-lint-deferral.bats` |
| 1.3 | 0.2% | `tests/verify.bats` |
| 1.3 | 0.2% | `tests/spawn-census.bats` |
| 1.2 | 0.2% | `tests/install-check.bats` |
| 1.2 | 0.2% | `tests/linear-check.bats` |
| 1.2 | 0.2% | `tests/deferral-check.bats` |
| 1.2 | 0.2% | `tests/ci-lease-precondition.bats` |
| 1.1 | 0.2% | `tests/land-divergence-assert.bats` |
| 1.1 | 0.2% | `tests/done-check.bats` |
| 1.1 | 0.2% | `tests/awk-regex-check.bats` |
| 1.1 | 0.2% | `tests/nonverdict-scan.bats` |
| 1.0 | 0.2% | `tests/module-map-check.bats` |
| 0.9 | 0.2% | `tests/perf-assert.bats` |
| 0.9 | 0.2% | `tests/fact-record-keying.bats` |
| 0.9 | 0.2% | `tests/release-backfill.bats` |
| 0.8 | 0.1% | `tests/lint-rego.bats` |
| 0.8 | 0.1% | `tests/doctor.bats` |
| 0.8 | 0.1% | `tests/done-pr-check.bats` |
| 0.8 | 0.1% | `tests/timeout-drift.bats` |
| 0.8 | 0.1% | `tests/render-cli.bats` |
| 0.8 | 0.1% | `tests/attestation-check.bats` |
| 0.8 | 0.1% | `tests/pr-unsubscribed.bats` |
| 0.7 | 0.1% | `tests/hook-matcher-check.bats` |
| 0.7 | 0.1% | `tests/suite-bench-check.bats` |
| 0.7 | 0.1% | `tests/evaluator-closure-check.bats` |
| 0.7 | 0.1% | `tests/sbom-binary.bats` |
| 0.7 | 0.1% | `tests/stop-posture-check.bats` |
| 0.7 | 0.1% | `tests/publish-credential-check.bats` |
| 0.7 | 0.1% | `tests/mcp-attach-check.bats` |
| 0.7 | 0.1% | `tests/duplicate-close-check.bats` |
| 0.6 | 0.1% | `tests/merged-pr-keys.bats` |
| 0.6 | 0.1% | `tests/mcp-timeout-budget.bats` |
| 0.6 | 0.1% | `tests/perf-compare.bats` |
| 0.6 | 0.1% | `tests/verified.bats` |
| 0.6 | 0.1% | `tests/checksums.bats` |
| 0.6 | 0.1% | `tests/pipefail-grep-check.bats` |
| 0.6 | 0.1% | `tests/commit-attribution.bats` |
| 0.6 | 0.1% | `tests/hook-pin-check.bats` |
| 0.6 | 0.1% | `tests/land-lock-check.bats` |
| 0.5 | 0.1% | `tests/digest-major-agreement.bats` |
| 0.5 | 0.1% | `tests/board-payloads.bats` |
| 0.5 | 0.1% | `tests/connector-allow-guard.bats` |
| 0.5 | 0.1% | `tests/run-shape-guard-quoting.bats` |
| 0.5 | 0.1% | `tests/sonar-gate.bats` |
| 0.5 | 0.1% | `tests/abandon-matrix.bats` |
| 0.5 | 0.1% | `tests/branch-age-check.bats` |
| 0.5 | 0.1% | `tests/msrv-pin-agreement.bats` |
| 0.5 | 0.1% | `tests/timeout-check.bats` |
| 0.5 | 0.1% | `tests/transcript-corpus-check.bats` |
| 0.5 | 0.1% | `tests/license-table-check.bats` |
| 0.5 | 0.1% | `tests/macos-link-check.bats` |
| 0.5 | 0.1% | `tests/commit-attribution.bats` |
| 0.5 | 0.1% | `tests/publish-credential-check.bats` |
| 0.4 | 0.1% | `tests/sonar-gate.bats` |
| 0.4 | 0.1% | `tests/hook-pin-check.bats` |
| 0.4 | 0.1% | `tests/msrv-pin-agreement.bats` |
| 0.4 | 0.1% | `tests/digest-major-agreement.bats` |
| 0.4 | 0.1% | `tests/pipefail-grep-check.bats` |
| 0.4 | 0.1% | `tests/board-payloads.bats` |
| 0.4 | 0.1% | `tests/branch-age-check.bats` |
| 0.4 | 0.1% | `tests/connector-allow-guard.bats` |
| 0.4 | 0.1% | `tests/run-shape-guard-quoting.bats` |
| 0.4 | 0.1% | `tests/abandon-matrix.bats` |
| 0.4 | 0.1% | `tests/land-lock-check.bats` |
| 0.4 | 0.1% | `tests/timeout-check.bats` |
| 0.4 | 0.1% | `tests/transcript-corpus-check.bats` |
| 0.4 | 0.1% | `tests/serena-mcp.bats` |
| 0.4 | 0.1% | `tests/report-only-check.bats` |
| 0.4 | 0.1% | `tests/no-doctests.bats` |
| 0.4 | 0.1% | `tests/commit-convention.bats` |
| 0.4 | 0.1% | `tests/release-due.bats` |
| 0.4 | 0.1% | `tests/nonverdict-assert.bats` |
| 0.3 | 0.1% | `tests/cap-drift.bats` |
| 0.3 | 0.1% | `tests/no-doctests.bats` |
| 0.3 | 0.1% | `tests/license-table-check.bats` |
| 0.3 | 0.1% | `tests/commit-convention.bats` |
| 0.3 | 0.1% | `tests/nonverdict-assert.bats` |
| 0.3 | 0.1% | `tests/report-only-check.bats` |
| 0.3 | 0.1% | `tests/release-due.bats` |
| 0.3 | 0.1% | `tests/connector-allow-resolve.bats` |
| 0.3 | 0.1% | `tests/batten-glob-check.bats` |
| 0.3 | 0.0% | `tests/cap-drift.bats` |
| 0.3 | 0.0% | `tests/container-preflight.bats` |
| 0.3 | 0.0% | `tests/ci-drift.bats` |
| 0.3 | 0.0% | `tests/coderabbit-config-check.bats` |
| 0.3 | 0.0% | `tests/rust-paths-check.bats` |
| 0.3 | 0.0% | `tests/batten-glob-check.bats` |
| 0.3 | 0.0% | `tests/git-hook.bats` |
| 0.2 | 0.0% | `tests/token-bench-check.bats` |
| 0.3 | 0.0% | `tests/container-preflight.bats` |
| 0.2 | 0.0% | `tests/coderabbit-config-check.bats` |
| 0.2 | 0.0% | `tests/ci-drift.bats` |
| 0.2 | 0.0% | `tests/mise-action-floor.bats` |
| 0.2 | 0.0% | `tests/rust-paths-check.bats` |
| 0.2 | 0.0% | `tests/perf-gate.bats` |
| 0.2 | 0.0% | `tests/token-bench-check.bats` |
| 0.2 | 0.0% | `tests/remedy-payload-source.bats` |
| 0.2 | 0.0% | `tests/evaluator-io-check.bats` |
| 0.2 | 0.0% | `tests/dist.bats` |
| 0.2 | 0.0% | `tests/task-fail-closed.bats` |
| 0.2 | 0.0% | `tests/egress-check.bats` |
| 0.1 | 0.0% | `tests/dist.bats` |
| 0.1 | 0.0% | `tests/evaluator-io-check.bats` |
| 0.1 | 0.0% | `tests/egress-check.bats` |
| 0.1 | 0.0% | `tests/darwin-link.bats` |
| 0.1 | 0.0% | `tests/cross-check.bats` |
| 0.0 | 0.0% | `tests/cross-check.bats` |
| 0.0 | 0.0% | `tests/zizmor-split.bats` |
Loading
Loading