Skip to content

feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report - #931

Merged
don-petry merged 3 commits into
mainfrom
dev-lead/issue-844-20260625-0941
Jun 25, 2026
Merged

don-petry merged 3 commits into
mainfrom
dev-lead/issue-844-20260625-0941

Conversation

@don-petry

@don-petry don-petry commented Jun 25, 2026 •

Copy link
Copy Markdown
Collaborator

Closes #844

Implemented by dev-lead agent. Please review.

Summary by CodeRabbit

  • New Features

    • Added a new LSP pilot report with side-by-side candidate results, success verdicts, coverage status, and a final recommendation.
    • Included candidate run data and report generation support for the pilot comparison.
  • Documentation

    • Updated pilot docs to link to the new report and clarify how comparison runs are organized and interpreted.
  • Tests

    • Added coverage for report metrics, verdicts, missing-run handling, and multi-candidate output.

@don-petry
don-petry requested a review from a team as a code owner June 25, 2026 09:58
@chatgpt-codex-connector

Copy link
Copy Markdown

You have reached your Codex usage limits for code reviews. You can see your limits in the Codex usage dashboard.
To continue using code reviews, you can upgrade your account or add credits to your account and enable them for code reviews in your settings.

@coderabbitai

coderabbitai Bot commented Jun 25, 2026 •

Copy link
Copy Markdown

Review Change Stack

Warning

Review limit reached

@don-petry, we couldn't start this review because you've reached your PR review rate limit.

More reviews will be available in 49 minutes and 9 seconds. Learn how PR review limits work.

Your organization has used up its prepaid credits, and credit purchases are no longer available. Enable the review add-on in the billing tab to keep reviews running — you're only billed for reviews past your plan's rate limits ($0.25/file).

⌛ How to resolve this issue?

After more reviews become available, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

To avoid repeated limits, reduce automatic review volume by pausing incremental auto-reviews earlier, using label-based review opt-in, excluding WIP or generated PR titles, or requesting reviews manually when the PR is ready. If your team needs uninterrupted high-volume reviews, an organization admin can enable usage-based credits.

🚦 How do rate limits work?

CodeRabbit enforces per-developer PR review limits for each organization. Most developers receive the normal plan review availability.

For paid Pro and Pro+ PR reviews, CodeRabbit uses adaptive limits for sustained high-volume activity. When a developer's recent PR review activity reaches the 95th percentile or higher among CodeRabbit users, additional reviews become available more gradually as earlier reviews age out of the rolling window.

Please see our Fair Usage Limits Policy for further information.

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro

Run ID: ddc2f090-57da-4f6b-b3d4-f79b2280aa85

📥 Commits

Reviewing files that changed from the base of the PR and between f2bbe6e and 49ace71.

📒 Files selected for processing (4)
  • .markdownlint-cli2.jsonc
  • docs/lsp-pilot-report.md
  • scripts/lsp_pilot_report.sh
  • tests/lsp_pilot_report.bats
📝 Walkthrough

Walkthrough

This PR adds an LSP pilot report generator, synthetic candidate run captures, report documentation, and Bats/CI coverage for the new report workflow.

Changes

LSP pilot report generation

Layer / File(s) Summary
Inputs and references
docs/lsp-pilot.md, evals/lsp-pilot/README.md, evals/lsp-pilot/runs/agent-lsp.jsonl, evals/lsp-pilot/runs/serena.jsonl
The pilot docs now point to the generated report, the runs directory is documented as candidate LSP-on captures, and the two candidate JSONL files add synthetic run records.
Shared evaluation helpers
scripts/lsp_pilot_report.sh
Cold-start stats, SLA classification, skip/degraded annotations, corpus coverage checks, navigation-token ratios, and false-positive regression checks are added.
Verdict and renderer
scripts/lsp_pilot_report.sh
The script adds candidate GO/NO-GO evaluation, per-candidate Markdown rendering, cross-candidate selection logic, and a CLI entrypoint.
Rendered report artifact
docs/lsp-pilot-report.md
The generated report now includes the reproduction command, per-candidate sections, aggregate metrics, SLA status, coverage annotations, and the cross-candidate summary.
Tests and CI wiring
tests/lsp_pilot_report.bats, .github/workflows/lint.yml
The new Bats suite covers the helpers and full renderer, and the lint workflow now runs that test file.

Sequence Diagram(s)

sequenceDiagram
  participant render_pilot_report
  participant "scripts/lsp_pilot_compare.sh" as lsp_pilot_compare_sh
  participant lpr_candidate_verdict
  render_pilot_report->>lsp_pilot_compare_sh: render per-candidate comparison output
  render_pilot_report->>lpr_candidate_verdict: compute GO/NO-GO verdict
  lpr_candidate_verdict-->>render_pilot_report: verdict text and exit status
Loading

Estimated code review effort

🎯 4 (Complex) | ⏱️ ~60 minutes

Possibly related PRs

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly names the main change: implementing issue #844 and the Phase 3 comparative report.
Linked Issues check ✅ Passed The PR adds the report renderer, run captures, metrics, and skip/degraded annotations required by #844.
Out of Scope Changes check ✅ Passed The changes stay focused on the LSP pilot report, supporting fixtures, docs, workflow hook, and tests.
Docstring Coverage ✅ Passed Docstring coverage is 91.67% which is sufficient. The required threshold is 80.00%.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch dev-lead/issue-844-20260625-0941

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request implements the LSP pilot comparative report renderer (scripts/lsp_pilot_report.sh), adding documentation, candidate run datasets, and BATS unit tests. The review feedback focuses on improving script robustness under set -u by validating positional parameters across multiple functions, explicitly checking for CLI dependencies (jq and awk) at the entry point, and adding error handling for mktemp calls in the test suite.

Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread scripts/lsp_pilot_report.sh Resolved
Comment thread tests/lsp_pilot_report.bats Resolved
Comment thread tests/lsp_pilot_report.bats Resolved
@coderabbitai

coderabbitai Bot commented Jun 25, 2026

Copy link
Copy Markdown

Caution

Failed to replace (edit) comment. This is likely due to insufficient permissions or the comment being deleted.

Error details
{"name":"HttpError","status":500,"request":{"method":"PATCH","url":"https://api.github.com/repos/petry-projects/.github-private/issues/comments/4798023719","headers":{"accept":"application/vnd.github.v3+json","user-agent":"octokit.js/0.0.0-development octokit-core.js/7.0.6 Node.js/24","authorization":"token [REDACTED]","content-type":"application/json; charset=utf-8"},"body":{"body":"<!-- This is an auto-generated comment: summarize by coderabbit.ai -->\n<!-- review_stack_entry_start -->\n\n[![Review Change Stack](https://storage.googleapis.com/coderabbit_public_assets/review-stack-in-coderabbit-ui.svg)](https://app.coderabbit.ai/change-stack/petry-projects/.github-private/pull/931?utm_source=github_walkthrough&utm_medium=github&utm_campaign=change_stack)\n\n<!-- review_stack_entry_end -->\n<!-- This is an auto-generated comment: review in progress by coderabbit.ai -->\n\n> [!NOTE]\n> Currently processing new changes in this PR. This may take a few minutes, please wait...\n> \n> <details>\n> <summary>⚙️ Run configuration</summary>\n> \n> **Configuration used**: Organization UI\n> \n> **Review profile**: ASSERTIVE\n> \n> **Plan**: Pro\n> \n> **Run ID**: `8ba83a14-54ea-4ddb-ad61-3cfdfe7815d7`\n> \n> </details>\n> \n> <details>\n> <summary>📥 Commits</summary>\n> \n> Reviewing files that changed from the base of the PR and between ca73abe8efce7722a48c885fb51fa83061ab5b5e and f2bbe6e6018dcbbefc9190ec227d0cc5c94a5f6a.\n> \n> </details>\n> \n> <details>\n> <summary>📒 Files selected for processing (8)</summary>\n> \n> * `.github/workflows/lint.yml`\n> * `docs/lsp-pilot-report.md`\n> * `docs/lsp-pilot.md`\n> * `evals/lsp-pilot/README.md`\n> * `evals/lsp-pilot/runs/agent-lsp.jsonl`\n> * `evals/lsp-pilot/runs/serena.jsonl`\n> * `scripts/lsp_pilot_report.sh`\n> * `tests/lsp_pilot_report.bats`\n> \n> </details>\n> \n> ```ascii\n>  ____________________________________________________________________________________________________________________\n> < Always design for concurrency. Allow for concurrency, and you'll design cleaner interfaces with fewer assumptions. >\n>  --------------------------------------------------------------------------------------------------------------------\n>   \\\n>    \\   (\\__/)\n>        (•ㅅ•)\n>        /   づ\n> ```\n\n<!-- end of auto-generated comment: review in progress by coderabbit.ai -->\n\n<!-- finishing_touch_checkbox_start -->\n\n<details>\n<summary>✨ Finishing Touches</summary>\n\n<details>\n<summary>📝 Generate docstrings</summary>\n\n- [ ] <!-- {\"checkboxId\": \"7962f53c-55bc-4827-bfbf-6a18da830691\"} --> Create stacked PR\n- [ ] <!-- {\"checkboxId\": \"3e1879ae-f29b-4d0d-8e06-d12b7ba33d98\"} --> Commit on current branch\n\n</details>\n<details>\n<summary>🧪 Generate unit tests (beta)</summary>\n\n- [ ] <!-- {\"checkboxId\": \"f47ac10b-58cc-4372-a567-0e02b2c3d479\", \"radioGroupId\": \"utg-output-choice-group-unknown_comment_id\"} -->   Create PR with unit tests\n- [ ] <!-- {\"checkboxId\": \"6ba7b810-9dad-11d1-80b4-00c04fd430c8\", \"radioGroupId\": \"utg-output-choice-group-unknown_comment_id\"} -->   Commit unit tests in branch `dev-lead/issue-844-20260625-0941`\n\n</details>\n\n</details>\n\n<!-- finishing_touch_checkbox_end -->\n<!-- tips_start -->\n\n---\n\nThanks for using [CodeRabbit](https://coderabbit.ai?utm_source=oss&utm_medium=github&utm_campaign=petry-projects/.github-private&utm_content=931)! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.\n\n<details>\n<summary>❤️ Share</summary>\n\n- [X](https://twitter.com/intent/tweet?text=I%20just%20used%20%40coderabbitai%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20the%20proprietary%20code.%20Check%20it%20out%3A&url=https%3A//coderabbit.ai)\n- [Mastodon](https://mastodon.social/share?text=I%20just%20used%20%40coderabbitai%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20the%20proprietary%20code.%20Check%20it%20out%3A%20https%3A%2F%2Fcoderabbit.ai)\n- [Reddit](https://www.reddit.com/submit?title=Great%20tool%20for%20code%20review%20-%20CodeRabbit&text=I%20just%20used%20CodeRabbit%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20proprietary%20code.%20Check%20it%20out%3A%20https%3A//coderabbit.ai)\n- [LinkedIn](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fcoderabbit.ai&mini=true&title=Great%20tool%20for%20code%20review%20-%20CodeRabbit&summary=I%20just%20used%20CodeRabbit%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20proprietary%20code)\n\n</details>\n\n\n<sub>Comment `@coderabbitai help` to get the list of available commands.</sub>\n\n<!-- tips_end -->"},"request":{"retryCount":3,"signal":{},"retries":3,"retryAfter":16}}}

@don-petry

Copy link
Copy Markdown
Collaborator Author

Dev-Lead — review-changes (applied)

Changes committed and pushed.

@don-petry
don-petry enabled auto-merge (squash) June 25, 2026 10:02
@don-petry
don-petry disabled auto-merge June 25, 2026 10:03

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@scripts/lsp_pilot_report.sh`:
- Around line 303-343: The coverage check in lpr_pilot_report.sh currently only
prints a warning, so a candidate with missing corpus PRs can still reach GO.
Update the verdict path around lpr_coverage, lpr_candidate_verdict, and the
verdicts/go_names handling so cov_rc != 0 forces NO-GO for that candidate. If
the reduction ratio is used for the final decision, also adjust the nav-total
logic to include uncovered corpus PRs instead of excluding them, so the
token-reduction result stays consistent with the full corpus.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: ASSERTIVE

Plan: Pro

Run ID: 8ba83a14-54ea-4ddb-ad61-3cfdfe7815d7

📥 Commits

Reviewing files that changed from the base of the PR and between ca73abe and f2bbe6e.

📒 Files selected for processing (8)
  • .github/workflows/lint.yml
  • docs/lsp-pilot-report.md
  • docs/lsp-pilot.md
  • evals/lsp-pilot/README.md
  • evals/lsp-pilot/runs/agent-lsp.jsonl
  • evals/lsp-pilot/runs/serena.jsonl
  • scripts/lsp_pilot_report.sh
  • tests/lsp_pilot_report.bats

Comment thread scripts/lsp_pilot_report.sh Resolved
@don-petry

Copy link
Copy Markdown
Collaborator Author

@coderabbitai resolve

@don-petry

Copy link
Copy Markdown
Collaborator Author

Dev-Lead — review-changes (applied)

Changes committed and pushed.

@don-petry
don-petry enabled auto-merge (squash) June 25, 2026 10:09
@coderabbitai

coderabbitai Bot commented Jun 25, 2026

Copy link
Copy Markdown
✅ Action performed

Comments resolved and changes approved.

@don-petry
don-petry disabled auto-merge June 25, 2026 10:10
@sonarqubecloud

Copy link
Copy Markdown

@don-petry

Copy link
Copy Markdown
Collaborator Author

Dev-Lead — waiting on PR blockers (intent: fix-reviews)

PR: #931
No changes were committed, but the PR still has blocking checks or reviews (failing or cancelled checks, or changes-requested reviews). The retry cron will re-attempt automatically. Next attempt after: 2026-06-25T10:44:43Z

@don-petry
don-petry enabled auto-merge (squash) June 25, 2026 10:14

@donpetry-bot donpetry-bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review — APPROVED ✓

Risk: LOW
Reviewed commit: 49ace714746e827465364cedd316e45a10bf2b04
Review mode: triage-approved (single reviewer)

Summary

Additive LSP-pilot tooling: a new pure-bash comparative report renderer (scripts/lsp_pilot_report.sh) that consumes the existing story-2 harness (lsp_pilot_compare.sh) plus a 234-line Bats suite, a generated seed report, synthetic de-identified candidate run captures, a lint-workflow wiring line, and an MD024 markdownlint relaxation. No review-engine behavior change and no production code path touched.

Linked issue analysis

Closes #844 (story: run comparison for the LSP pilot, epic #839). The PR substantively delivers it: per-candidate GO/NO-GO success-metric verdict (>=2x nav-token reduction AND no false-positive/precision regression AND cold-start P95 within the 30s SLA), cold-start P50/P95 vs SLA, honest SLA-skip/MCP-degraded annotations, and a corpus-coverage smoke check. The report is explicitly flagged as seed/structural data until the real corpus is repinned, which matches the epic's contract.

Findings

No blocking findings.

  • Security: pure bash, no network, no secrets/credentials, no eval or injection vectors; reads JSONL via jq/awk. agent-shield, CodeQL, gitleaks, and SonarCloud all green. Committed run data is synthetic/de-identified with zeroed SHAs.
  • Advisory bots: gemini-code-assist raised 11 MEDIUM suggestions (arg-count guards under set -u; command -v dependency check). All are already implemented in the reviewed head — the functions carry the requested guards and main() checks jq/awk. Nothing outstanding.
  • SonarCloud quality gate passed (0 new issues). Codex review hit a usage limit (no substantive feedback); CodeRabbit was rate-limited.
  • Secret-scanning MCP tool not available in this environment; relied on the gitleaks CI check, which passed.
  • Coverage: helpers and the full renderer are unit-tested, including SLA breach, MCP-degraded, MISSING-corpus, ratio, quality-regression, and the data-favored tie-break path.

CI status

All required checks green: Lint, shellcheck/ShellCheck, bats/unit-tests, CodeQL, Analyze (actions/python), agent-shield, SonarCloud, gitleaks, holdout-guard, validate-agent-profiles, gh-aw-compile. SKIPPED checks are inapplicable conditionals (dependency-audit ecosystems, dependabot). CANCELLED entries are the dev-lead agent's own dispatch/ci-relay relay jobs, not failures. No human review threads or unanswered questions; downstream-impact: none.


Reviewed automatically by the PR-review agent (single-reviewer mode: fable 5). Reply if you need a human review.

@don-petry
don-petry merged commit 49b29d8 into main Jun 25, 2026
48 of 86 checks passed
@don-petry
don-petry deleted the dev-lead/issue-844-20260625-0941 branch June 25, 2026 12:11
don-petry added a commit that referenced this pull request Aug 2, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 3, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 3, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 3, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 7, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 8, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 8, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 8, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 8, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
don-petry added a commit that referenced this pull request Aug 18, 2026
…render the speed/quality/cost report (#931)

* feat: implement issue #844 — [Phase 3] Run the comparative pilot and render the speed/quality/cost report

* chore: apply manual instructions [skip ci-relay]

* chore: apply manual instructions [skip ci-relay]

---------

Co-authored-by: donpetry-bot <281750570+donpetry-bot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Phase 3] Run the comparative pilot and render the speed/quality/cost report

2 participants