-
Notifications
You must be signed in to change notification settings - Fork 5
Revisiting the idealized GATE simulation #397
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
|
Do you mind if I do some git history surgery to remove the commits from #369? 🥲 |
no not at all. I can also just put this file into a clean branch. |
|
Surgery done 😁 |
|
Did you mean to include this in the list of example in docs/make.jl? |
|
See all the discussion above starting from
Summary: this simulation is particularly expensive, even at a reduced resolution it'd be impractical for running it on CI. |
So the question is: do we just place this script, untested, in the repo somewhere (eg in |
This PR adds a case for the "idealized GATE" simulation of tropical deep convection over the ocean which is implemented in the System for Atmospheric Modeling, described by Khairoutdinov et al 2009. Some performance results were reported by Bogenschutz et al 2025 for the doubly-periodic version of SCREAM in which 3.6 simulated days per day were achieved with 384 A100s.
Using much simpler microphysics and no radiation scheme, the same resolution for us gets ~1.2 SDPD on a single H200 at single precision --- 24 hours of simulation time takes ~17 hours of wall time on one GPU. Here is an animation from that simulation:
gate.mp4
We should work towards running this case with P3 microphysics (preliminary draft work on #395) and interactive radiation to refine the benchmark. I believe this can also serve as a canonical case for performance benchmarking.
I am unsure how to do contribute this case to the repo. At full resolution the grid looks like
and the simulation state consumes ~96 GB:
even at quarter resolution (512x512x181) this is a large simulation. Possibly we cannot afford to run the full 24 hours of this case in CI, even infrequently. Perhaps the thing to do is just to test that the setup works by building it at low resolution and running a few time-steps. And we will report results by manually uploading figures / movies to the documentation (if that is desired).