Skip to content

v17: Update NSST dtf file and master idx#4538

Merged
CatherineThomas-NOAA merged 2 commits intoNOAA-EMC:dev/gfs.v17from
CatherineThomas-NOAA:v17_dtf_pr4523
Feb 11, 2026
Merged

v17: Update NSST dtf file and master idx#4538
CatherineThomas-NOAA merged 2 commits intoNOAA-EMC:dev/gfs.v17from
CatherineThomas-NOAA:v17_dtf_pr4523

Conversation

@CatherineThomas-NOAA
Copy link
Contributor

Description

This PR merges #4523 and its prerequisite PR #4299 into the dev/gfs.v17 branch. It changes the NSST output naming convention from "analysis" to "increment" to better reflect what's actually in the file. PR#4523 also adds the idx file creation for the master grib files.

Type of change

  • Bug fix (fixes something broken)

Change characteristics

  • Is this change expected to change outputs (e.g. value changes to existing outputs, new files stored in COM, files removed from COM, filename changes, additions/subtractions to archives)? YES
    • GFS
    • [?] GEFS
    • [?] SFS
    • GCAFS
  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? YES

How has this been tested?

Ran generate_workflows.sh -G -E -S -C run on Cactus and Gaea-C6. Results as expected and shared in the comments.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

CoryMartin-NOAA and others added 2 commits February 9, 2026 22:46
This fixes 2 bugs:
1) GCAFS was naively using the NSST increment from GDAS, because the
filename suggested it was an analysis and not an increment. A new
utility is being added to GFS-Utils to calculate this instead of just
using it directly
2) Rename the files so that this mix up won't happen in the future
It was noted in NOAA-EMC#4299 that the NSST dtfanl files being produced by GSI
were really increment files. This PR renames all global workflow
variables from `DTFANL` to `DTFINC` and also renames the file within and
saved by the global workflow to `dtfinc.nc`.

  Resolves NOAA-EMC#4395
  Resolves NOAA-EMC#4505
@CatherineThomas-NOAA
Copy link
Contributor Author

WCOSS2 CI Tests

All tests passed except for C48_S2SWA_gefs, C96_gcafs_cycled_noDA, and C96_gcafs_cycled.

SKIP C48_ATM_ecflow on wcoss2
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C48_ATM_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 00:55:12    Feb 10 2026 01:50:14
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C48mx500_3DVarAOWCDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 00:55:08    Feb 10 2026 01:10:13
202103250000        Done    Feb 10 2026 00:55:08    Feb 10 2026 02:30:19
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C48mx500_hybAOWCDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 00:55:09    Feb 10 2026 01:10:17
202103250000        Done    Feb 10 2026 00:55:09    Feb 10 2026 02:15:13
 
SKIP C48_S2SWA_gefs_RT on wcoss2
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C48_S2SWA_gefs_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200      Active    Feb 10 2026 00:55:21             -          
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C48_S2SW_extended_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 00:55:21    Feb 10 2026 03:25:24
202103231800        Done    Feb 10 2026 00:55:21    Feb 10 2026 03:10:21
 
SKIP C48_S2SW on wcoss2
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96_atm3DVar_extended_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 00:55:16    Feb 10 2026 01:15:17
202112210000        Done    Feb 10 2026 00:55:16    Feb 10 2026 05:40:21
202112210600        Done    Feb 10 2026 00:55:16    Feb 10 2026 06:30:22
202112211200        Done    Feb 10 2026 01:20:18    Feb 10 2026 07:55:11
202112211800        Done    Feb 10 2026 05:45:17    Feb 10 2026 10:25:24
 
SKIP C96_atm3DVar on wcoss2
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96C48_hybatmDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 00:55:49    Feb 10 2026 01:15:25
202112210000        Done    Feb 10 2026 00:55:49    Feb 10 2026 03:10:26
202112210600        Done    Feb 10 2026 00:55:49    Feb 10 2026 03:00:27
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96C48_hybatmsnowDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 00:55:14    Feb 10 2026 01:15:11
202112201800        Done    Feb 10 2026 00:55:14    Feb 10 2026 03:05:08
202112210000        Done    Feb 10 2026 00:55:14    Feb 10 2026 03:05:08
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96C48_hybatmsoilDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Feb 10 2026 00:55:20    Feb 10 2026 01:15:25
202205151200        Done    Feb 10 2026 00:55:20    Feb 10 2026 03:10:26
202205151800        Done    Feb 10 2026 00:55:20    Feb 10 2026 03:10:26
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96C48mx500_S2SW_cyc_gfs_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 00:55:45    Feb 10 2026 01:15:25
202112201800        Done    Feb 10 2026 00:55:45    Feb 10 2026 03:40:23
202112210000        Done    Feb 10 2026 00:55:45    Feb 10 2026 04:00:28
202112211800        Done    Feb 10 2026 01:20:20    Feb 10 2026 04:10:16
 
SKIP C96C48_ufsgsi_hybatmDA on wcoss2
 
SKIP C96C48_ufs_hybatmDA on wcoss2
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96_gcafs_cycled_noDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200      Active    Feb 10 2026 00:55:18             -          
202112201800      Active    Feb 10 2026 00:55:18             -          
202112210000      Active    Feb 10 2026 00:55:18             -          
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96_gcafs_cycled_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200      Active    Feb 10 2026 00:55:19             -          
202112201800      Active    Feb 10 2026 00:55:19             -          
202112210000      Active    Feb 10 2026 00:55:19             -          
 
/lfs/h2/emc/ptmp/catherine.thomas/RUNTESTS_dtf/EXPDIR/C96mx100_S2S_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
199405010000        Done    Feb 10 2026 00:55:43    Feb 10 2026 02:30:21

@CatherineThomas-NOAA
Copy link
Contributor Author

Gaea C6 CI Tests

The same GEFS and GCAFS tests failed on Gaea as well, with all other tests passing.

SKIP C48_ATM_ecflow on gaeac6
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C48_ATM_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 01:55:29    Feb 10 2026 03:00:07
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C48mx500_3DVarAOWCDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:15:07
202103250000        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:05:19
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C48mx500_hybAOWCDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103241800        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:15:07
202103250000        Done    Feb 10 2026 01:55:29    Feb 10 2026 04:40:10
 
SKIP C48_S2SWA_gefs_RT on gaeac6
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C48_S2SWA_gefs_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200      Active    Feb 10 2026 01:55:29             -          
 
SKIP C48_S2SW_extended on gaeac6
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C48_S2SW_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202103231200        Done    Feb 10 2026 01:55:29    Feb 10 2026 03:10:32
 
SKIP C96_atm3DVar_extended on gaeac6
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96_atm3DVar_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:15:07
202112210000        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:00:35
202112210600        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:15:29
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96C48_hybatmDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201800        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:15:07
202112210000        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:00:35
202112210600        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:35:14
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96C48_hybatmsnowDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:15:07
202112201800        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:05:18
202112210000        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:40:15
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96C48_hybatmsoilDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202205150600        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:20:08
202205151200        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:00:35
202205151800        Done    Feb 10 2026 01:55:29    Feb 10 2026 05:45:09
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96C48mx500_S2SW_cyc_gfs_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200        Done    Feb 10 2026 01:55:29    Feb 10 2026 02:15:08
202112201800        Done    Feb 10 2026 01:55:29    Feb 10 2026 06:05:30
202112210000        Done    Feb 10 2026 01:55:29    Feb 10 2026 06:40:23
 
SKIP C96C48_ufsgsi_hybatmDA on gaeac6
 
SKIP C96C48_ufs_hybatmDA on gaeac6
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96_gcafs_cycled_noDA_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200      Active    Feb 10 2026 01:55:29             -          
202112201800      Active    Feb 10 2026 01:55:29             -          
202112210000      Active    Feb 10 2026 01:55:29             -          
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96_gcafs_cycled_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
202112201200      Active    Feb 10 2026 01:55:29             -          
202112201800      Active    Feb 10 2026 01:55:29             -          
202112210000      Active    Feb 10 2026 01:55:29             -          
 
/gpfs/f6/gfs-cpu/world-shared/Catherine.Thomas/tmp/RUNTESTS_dtf/EXPDIR/C96mx100_S2S_dtf
   CYCLE         STATE           ACTIVATED              DEACTIVATED     
199405010000        Done    Feb 10 2026 01:55:29    Feb 10 2026 04:20:30

@CatherineThomas-NOAA
Copy link
Contributor Author

The v17 related tests passed on both machines. The only failures were in GEFS and GCAFS tests, which I believe is expected at this time for the dev/gfs.v17 branch.

I also ran the C96C48mx500_S2SW_cyc_gfs test with the current dev/gfs.v17 branch on WCOSS2 and the gsistat and gdas sfcanl files after 2.5 cycles reproduce the test from this PR.

Taking out of draft.

@CatherineThomas-NOAA
Copy link
Contributor Author

@JessicaMeixner-NOAA
Copy link
Contributor

@CatherineThomas-NOAA - We should only be running -G for dev/gfsv17 -- the other tests do fail, and the only thing that we're worried about is GFS tests.

@CatherineThomas-NOAA CatherineThomas-NOAA merged commit 8f3142d into NOAA-EMC:dev/gfs.v17 Feb 11, 2026
7 checks passed
@CatherineThomas-NOAA CatherineThomas-NOAA deleted the v17_dtf_pr4523 branch February 26, 2026 20:23
@CatherineThomas-NOAA CatherineThomas-NOAA restored the v17_dtf_pr4523 branch February 26, 2026 20:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants