Repository navigation
Conversation
Reduce PR CI to the H100 conda Python test jobs, run them against nightly packages, repeat the CAGRA and cuvs_bench CLI tests, and dump host and GPU stacks when a hang is detected.
…etween test modules
|
Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually. Contributors can view more details about this message here. |
Contributor
Author
|
/ok to test 114e7ff |
1 of 12 tasks
Contributor
Author
|
/ok to test 9f47a7d |
bdice
changed the title
Contributor
Author
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Diagnostic-only companion to #2809 for #2772 / #2732 (coordination: #2783). It runs the
test_product_quantizer.py+test_cagra.pyreproducer on12.9.2, ubuntu24.04, h100(595 driver), with one experiment per job:cachenv:CUDA_CACHE_DISABLE=1, and~/.nvis removed before every iteration.cachecupy:CUPY_CACHE_IN_MEMORY=1, and~/.cupyis removed before every iteration.cachewarm: control. Before the loop, it runs a probe withCUDA_DISABLE_PTX_JIT=1to find modules that need a PTX JIT.After the first two iterations, each job lists the cache contents and the mangled kernel names found in them.