Use only a single GPU/numa node for distributed tests#1121
Merged
Use only a single GPU/numa node for distributed tests#1121
Conversation
msimberg
force-pushed
the
distributed-single-gpu
branch
from
1fa1486 to
3e39f63
Compare
Contributor
Author
|
cscs-ci run distributed |
|
Mandatory Tests Please make sure you run these tests via comment before you merge!
Optional Tests To run benchmarks you can use:
To run tests and benchmarks with the DaCe backend you can use:
To run test levels ignored by the default test suite (mostly simple datatest for static fields computations) you can use:
For more detailed information please look at CI in the EXCLAIM universe. |
msimberg
commented
Mar 23, 2026
| - echo "using virtual environment at ${UV_PROJECT_ENVIRONMENT}" | ||
| - source ${UV_PROJECT_ENVIRONMENT}/bin/activate | ||
| - echo "running with $(python --version)" | ||
| - source ci/scripts/start-cuda-mps.sh |
Contributor
Author
There was a problem hiding this comment.
This is not strictly needed, yet, but it'll be needed for #1012.
Contributor
|
cscs-ci run default |
Contributor
|
cscs-ci run distributed |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Since tests are currently anyway serialized, I think we don't benefit from running across the full node. This uses MPS to run all four ranks on a single GPU. This is based on #819.