Skip to content

Use DATAROOT space for gsidiags in dev/gfs.v17#4537

Merged
CatherineThomas-NOAA merged 6 commits intoNOAA-EMC:dev/gfs.v17from
DavidHuber-NOAA:feature/gsidiags_v17
Feb 11, 2026
Merged

Use DATAROOT space for gsidiags in dev/gfs.v17#4537
CatherineThomas-NOAA merged 6 commits intoNOAA-EMC:dev/gfs.v17from
DavidHuber-NOAA:feature/gsidiags_v17

Conversation

@DavidHuber-NOAA
Copy link
Contributor

Description

This will bring in PRs #4476 and #4487 to the dev/gfs.v17 branch to enable the use of DATAROOT space for gsi diagnostic files, which allows easy use of links rather than sending a tarball to COM.

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this change expected to change outputs YES
    • GFS (removes the gsidiags tarball from COM)
  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO

How has this been tested?

Currently testing a C96C48mx500_S2SW_cyc_gfs case on Gaea C6.

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added

@CatherineThomas-NOAA
Copy link
Contributor

While CI tests are still running on WCOSS2, the C96C48mx500_S2SW_cyc_gfs test has gone 2.5 cycles and can now be compared with a test that I recently ran for #4538.

The deterministic gsistat files after 2.5 cycles are identical between this PR's test and from the head of the dev/gfs.v17 branch. The ensemble mean gsistat files are similarly identical.

I also untarred the radstat, cnvstat, and oznstat files for both the deterministic and ensemble means and the diags contained within are also identical between this PR and current dev/gfs.v17.

Looks good to me, but I'll wait until the CI is fully complete to approve.

@JessicaMeixner-NOAA
Copy link
Contributor

WCOSS2 CI extended test is still running, but all others have passed:

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48_ATM_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 15:56:14    Feb 10 2026 16:48:18

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 15:56:08    Feb 10 2026 16:12:14
202103250000        Done    Feb 10 2026 15:56:08    Feb 10 2026 17:28:13

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 15:56:17    Feb 10 2026 16:12:12
202103250000        Done    Feb 10 2026 15:56:17    Feb 10 2026 17:12:09

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48_S2SW_extended_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 15:56:14    Feb 10 2026 18:04:15
202103231800        Done    Feb 10 2026 15:56:14    Feb 10 2026 17:56:16

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96_atm3DVar_extended_gsi04 ********
202112210600       gfs_arch_tar_gfsa                   248012011             RUNNING                   -         0           0.0
202112211200           gfs_fcst_seg1                   247998278             RUNNING                   -         0           0.0
202112211200        gfs_goesupp_f351                   248012800              QUEUED                   -         0           0.0
202112211200        gfs_goesupp_f354                   248012803              QUEUED                   -         0           0.0
202112211200        gfs_goesupp_f357                   248012802              QUEUED                   -         0           0.0
202112211200    gfs_gempak_f315-f327                   248012801              QUEUED                   -         0           0.0
202112211800           gfs_atmanlupp                   248012804              QUEUED                   -         0           0.0
202112211800           gfs_fcst_seg0                   248012023             RUNNING                   -         0           0.0
202112211800               gdas_anal                   248009045             RUNNING                   -         0           0.0

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48_hybatmDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 15:56:11    Feb 10 2026 16:12:22
202112210000        Done    Feb 10 2026 15:56:11    Feb 10 2026 18:04:13
202112210600        Done    Feb 10 2026 15:56:11    Feb 10 2026 17:48:15

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48_hybatmsnowDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 15:56:19    Feb 10 2026 16:12:42
202112201800        Done    Feb 10 2026 15:56:19    Feb 10 2026 18:01:07
202112210000        Done    Feb 10 2026 15:56:19    Feb 10 2026 17:52:20

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48_hybatmsoilDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Feb 10 2026 15:56:18    Feb 10 2026 16:16:19
202205151200        Done    Feb 10 2026 15:56:18    Feb 10 2026 18:08:15
202205151800        Done    Feb 10 2026 15:56:18    Feb 10 2026 18:00:47

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48mx500_S2SW_cyc_gfs_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 15:56:19    Feb 10 2026 16:12:12
202112201800        Done    Feb 10 2026 15:56:19    Feb 10 2026 18:24:17
202112210000        Done    Feb 10 2026 15:56:19    Feb 10 2026 18:44:17
202112211800        Done    Feb 10 2026 16:16:19    Feb 10 2026 18:52:22

@JessicaMeixner-NOAA
Copy link
Contributor

WCOSS2 CI passed:

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48_ATM_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 15:56:14    Feb 10 2026 16:48:18

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48mx500_3DVarAOWCDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 15:56:08    Feb 10 2026 16:12:14
202103250000        Done    Feb 10 2026 15:56:08    Feb 10 2026 17:28:13

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48mx500_hybAOWCDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 15:56:17    Feb 10 2026 16:12:12
202103250000        Done    Feb 10 2026 15:56:17    Feb 10 2026 17:12:09

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C48_S2SW_extended_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 15:56:14    Feb 10 2026 18:04:15
202103231800        Done    Feb 10 2026 15:56:14    Feb 10 2026 17:56:16

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96_atm3DVar_extended_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 15:56:20    Feb 10 2026 16:12:26
202112210000        Done    Feb 10 2026 15:56:20    Feb 10 2026 20:28:16
202112210600        Done    Feb 10 2026 15:56:20    Feb 10 2026 21:06:17
202112211200        Done    Feb 10 2026 16:16:19    Feb 10 2026 22:33:16
202112211800        Done    Feb 10 2026 20:32:17    Feb 11 2026 01:00:59

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48_hybatmDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 15:56:11    Feb 10 2026 16:12:22
202112210000        Done    Feb 10 2026 15:56:11    Feb 10 2026 18:04:13
202112210600        Done    Feb 10 2026 15:56:11    Feb 10 2026 17:48:15

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48_hybatmsnowDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 15:56:19    Feb 10 2026 16:12:42
202112201800        Done    Feb 10 2026 15:56:19    Feb 10 2026 18:01:07
202112210000        Done    Feb 10 2026 15:56:19    Feb 10 2026 17:52:20

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48_hybatmsoilDA_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Feb 10 2026 15:56:18    Feb 10 2026 16:16:19
202205151200        Done    Feb 10 2026 15:56:18    Feb 10 2026 18:08:15
202205151800        Done    Feb 10 2026 15:56:18    Feb 10 2026 18:00:47

******** /lfs/h2/emc/couple/noscrub/jessica.meixner/v17reworkgsi/RUNTESTS/EXPDIR/C96C48mx500_S2SW_cyc_gfs_gsi04 ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 15:56:19    Feb 10 2026 16:12:12
202112201800        Done    Feb 10 2026 15:56:19    Feb 10 2026 18:24:17
202112210000        Done    Feb 10 2026 15:56:19    Feb 10 2026 18:44:17
202112211800        Done    Feb 10 2026 16:16:19    Feb 10 2026 18:52:22

@DavidHuber-NOAA
Copy link
Contributor Author

All tests passed on C6 except C96C48mx500_S2SW_cyc_gfs. This test stalled due to the scron job getting stuck in a requeued held state. It is running now:

Wed Feb 11 09:11:19 AM EST 2026
******** C48_ATM_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 14:55:10    Feb 10 2026 19:00:14

******** C48mx500_3DVarAOWCDA_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 14:55:11    Feb 10 2026 15:10:11
202103250000        Done    Feb 10 2026 14:55:11    Feb 10 2026 19:20:11

******** C48mx500_hybAOWCDA_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 14:55:10    Feb 10 2026 15:40:10
202103250000        Done    Feb 10 2026 14:55:10    Feb 10 2026 18:36:37

******** C48_S2SW_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 14:55:11    Feb 10 2026 19:00:13

******** C96_atm3DVar_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 14:55:09    Feb 10 2026 15:45:08
202112210000        Done    Feb 10 2026 14:55:09    Feb 10 2026 18:40:39
202112210600        Done    Feb 10 2026 14:55:09    Feb 10 2026 19:15:13

******** C96C48_hybatmDA_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 14:55:10    Feb 10 2026 15:45:09
202112210000        Done    Feb 10 2026 14:55:10    Feb 10 2026 18:40:39
202112210600        Done    Feb 10 2026 14:55:10    Feb 10 2026 19:30:12

******** C96C48_hybatmsnowDA_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 14:55:10    Feb 10 2026 15:45:07
202112201800        Done    Feb 10 2026 14:55:10    Feb 10 2026 19:35:12
202112210000        Done    Feb 10 2026 14:55:10    Feb 10 2026 20:00:12

******** C96C48_hybatmsoilDA_v17_gsidiags ********
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Feb 10 2026 14:55:10    Feb 10 2026 16:30:08
202205151200        Done    Feb 10 2026 14:55:10    Feb 10 2026 19:35:12
202205151800        Done    Feb 10 2026 14:55:10    Feb 10 2026 19:45:12

******** C96C48mx500_S2SW_cyc_gfs_v17_gsidiags ********
202112201200           gdas_waveinit                   215909739              QUEUED                   -         0           0.0
202112201200           gdas_stage_ic                   215909740              QUEUED                   -         0           0.0
202112201200       enkfgdas_stage_ic                   215909741              QUEUED                   -         0           0.0

@DavidHuber-NOAA
Copy link
Contributor Author

DavidHuber-NOAA commented Feb 11, 2026

@JessicaMeixner-NOAA @CatherineThomas-NOAA would you like to proceed with merging this PR or wait for the last test to finish? In either case, I will continue to monitor the last case and report final status.

@CatherineThomas-NOAA
Copy link
Contributor

@DavidHuber-NOAA - Hm that is the most important test, though it did pass on WCOSS. However, not all streams are at a place where we can update the clone immediately anyway, so we can give that test more time to complete while those streams cycle to a clean stopping point.

@DavidHuber-NOAA
Copy link
Contributor Author

The C96C48mx500_S2SW_cyc_gfs test completed successfully 🎉.

RUNTESTS directory: /gpfs/f6/drsa-hurr1/world-shared/David.Huber/rt_gsidiags_v17.

@CatherineThomas-NOAA CatherineThomas-NOAA merged commit 37168f3 into NOAA-EMC:dev/gfs.v17 Feb 11, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants