Skip to content

Feature Request: Agent Evaluations print detailed results even when all tests pass #3891

Closed

Description

@quad2524

Is your feature request related to a problem? Please describe.
In AgentEvaluator, currently print_detailed_results=True only prints detailed results if there are failures. It is difficult to get detailed metrics output for successful runs in CI pipelines where visibility into passing tests is desired.

Describe the solution you'd like
I would like an additional flag, for example print_detailed_results_on_success, that when set to True (along with print_detailed_results=True), forces the printing of detailed results even if the evaluation passes.

Describe alternatives you've considered

  • Changing the default behavior of print_detailed_results to always print, but this would be a breaking change and might clutter logs for users who don't want it.
  • Parsing the return value manually, but evaluate is often used as a high-level entry point where return values are not easily accessible for printing in the same format.

Activity

  1. added
    eval[Component] This issue is related to evaluation
    on Dec 10, 2025
  2. added theissue type on Dec 10, 2025
  3. adk-bot commented on Dec 18, 2025

    @adk-bot
    Collaborator

    Notification: The author has updated the issue description. Maintainers, please review.

  4. mchibani commented on Dec 22, 2025

    @mchibani

    +1.
    Sometimes we lower the threshold to make the eval passes, but we still need to monitor the performance of the agents with new updates and possibly increase the threshold

  5. klateefa commented on Feb 11, 2026

    @klateefa

    @quad2524 Thank you for submitting this feature request. It’s currently under review by our team, and I’ll keep you posted on any updates. We appreciate your input!

  6. added
    needs review[Status] The PR/issue is awaiting review from the maintainer
    on Feb 11, 2026
  7. added a commit that references this issue on Aug 27, 2026
    e1ae543
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

eval[Component] This issue is related to evaluationneeds review[Status] The PR/issue is awaiting review from the maintainer

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions