Skip to content

Test infra improvements - #461

Merged
pjbull merged 14 commits into
masterfrom
test-infra-improvements
Aug 29, 2024
Merged

pjbull merged 14 commits into
masterfrom
test-infra-improvements

Conversation

@pjbull

@pjbull pjbull commented Aug 15, 2024 •

Copy link
Copy Markdown
Member

I'll say this is "ready" once I get 5 error-free passes.


A few improvements:

  • Add test timing reporting information for simple perf comparisons and debugging.
  • Unpin pytest/pytest-cases since new ones are compatible
  • Update waiting strategy for flakiest tests

@github-actions

github-actions Bot commented Aug 15, 2024 •

Copy link
Copy Markdown
Contributor

@github-actions
github-actions Bot temporarily deployed to pull request August 15, 2024 00:22 Inactive
@codecov

codecov Bot commented Aug 15, 2024 •

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.2%. Comparing base (5656879) to head (6f51524).
Report is 3 commits behind head on master.

Additional details and impacted files
@@          Coverage Diff           @@
##           master    #461   +/-   ##
======================================
  Coverage    94.2%   94.2%           
======================================
  Files          23      23           
  Lines        1728    1728           
======================================
  Hits         1629    1629           
  Misses         99      99           

@github-actions
github-actions Bot temporarily deployed to pull request August 15, 2024 05:16 Inactive
@github-actions
github-actions Bot temporarily deployed to pull request August 15, 2024 05:19 Inactive
@github-actions
github-actions Bot temporarily deployed to pull request August 15, 2024 05:36 Inactive
@github-actions
github-actions Bot temporarily deployed to pull request August 20, 2024 23:48 Inactive
@pjbull pjbull mentioned this pull request Aug 20, 2024
4 tasks done
@pjbull pjbull changed the title Test infra improvements WIP: Test infra improvements Aug 20, 2024
@github-actions
github-actions Bot temporarily deployed to pull request August 20, 2024 23:53 Inactive
@pjbull
pjbull force-pushed the test-infra-improvements branch from 2e9fbe3 to e33b583 Compare August 22, 2024 14:40
@github-actions
github-actions Bot temporarily deployed to pull request August 22, 2024 14:41 Inactive
@github-actions
github-actions Bot temporarily deployed to pull request August 22, 2024 15:17 Inactive
@github-actions
github-actions Bot temporarily deployed to pull request August 22, 2024 16:28 Inactive
@pjbull

pjbull commented Aug 22, 2024

Copy link
Copy Markdown
Member Author

@jayqi Ready, but not urgent. Thinking this can be just post-release since it is not really user-facing. I hope it improves test reliability, but in my experience failures seem to be related in some way to resource load on shared GH runners (failures seem to cluster in time). It just needs a history change added, but didn't want to collide with #463

@pjbull pjbull changed the title WIP: Test infra improvements Test infra improvements Aug 23, 2024
@pjbull
pjbull force-pushed the test-infra-improvements branch from 4d293f1 to 8045ed0 Compare August 28, 2024 23:52
@github-actions
github-actions Bot temporarily deployed to pull request August 28, 2024 23:53 Inactive
@github-actions
github-actions Bot temporarily deployed to pull request August 29, 2024 01:33 Inactive
@pjbull
pjbull merged commit b776bee into master Aug 29, 2024
@pjbull
pjbull deleted the test-infra-improvements branch August 29, 2024 18:25
@pjbull pjbull mentioned this pull request Aug 29, 2024

This branch was previously deployed

1 inactive deployment
pull request — 6f51524f Deployed Aug 29, 2024 by github-actions[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant