Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use standard grain source build in t5x arm64 Dockerfile #499

Merged
merged 2 commits into from
Jan 30, 2024

Conversation

gspschmid
Copy link
Contributor

@gspschmid gspschmid commented Jan 26, 2024

Thanks to @iindyk's recent fix in the copybara export of grain (see this commit) we no longer have to apply an intrusive patch in order to build grain from source as part of our T5X arm64 build.

A small issue remains, since some of the tests rely on missing dependencies at runtime, so we disable those two (see these logs).

cc @yhtang @olupton

@gspschmid gspschmid requested a review from olupton January 26, 2024 10:55
@gspschmid
Copy link
Contributor Author

gspschmid commented Jan 29, 2024

Rosetta-PAX tests are red due to Pallas tests failing (on both A100 and V100): https://github.com/NVIDIA/JAX-Toolbox/actions/runs/7671181458/job/20910215878?pr=499#step:8:29

@gspschmid
Copy link
Contributor Author

Given that the rosetta test failures seem unrelated (also happen on other PRs, also on x86 and afaict ultimately appear related to Pallas) I think we should be fine to merge this?

@gspschmid gspschmid force-pushed the gschmid/aarch64_t5x_cleanup branch from 9b543a1 to 8482c66 Compare January 30, 2024 10:28
Copy link
Collaborator

@olupton olupton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, will be added to the CI in #500.

@gspschmid gspschmid merged commit a233b1a into main Jan 30, 2024
91 of 93 checks passed
@gspschmid gspschmid deleted the gschmid/aarch64_t5x_cleanup branch January 30, 2024 15:06
ashors1 pushed a commit that referenced this pull request Feb 3, 2024
Thanks to @iindyk's recent fix in the copybara export of `grain` (see
[this commit](google/grain@b02754d))
we no longer have to apply an intrusive patch in order to build grain
from source as part of our T5X arm64 build.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants