Reduction in Ocean and Sea Ice Output

[NeilBarton-NOAA]

Description

Addressing
NOAA-EMC/GFS#37
NOAA-EMC/GFS#36
NOAA-EMC/GFS#4
#4163

Reducing the I/O burden by reducing the number of variables, layers, and adding compression.
Also adds archiving for native subsets

Type of change

• Bug fix (fixes something broken)
• New feature (adds functionality)
• Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

• Is this a breaking change (a change in existing functionality)? NO
• Does this change require a documentation update? NO
• Does this change require an update to any of the following submodules? NO (If YES, please add a link to any PRs that are pending.)
  • EMC verif-global
  • GDAS
  • GFS-utils
  • GSI
  • GSI-monitor
  • GSI-utils
  • UFS-utils
  • UFS-weather-model
  • wxflow

How has this been tested?

Tested using C192mx025 SFS forecasts. This will be a draft until GFS testing can be done.

Checklist

• Any dependent changes have been merged and published
• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have documented my code, including function, input, and output descriptions
• My changes generate no new warnings
• New and existing tests pass with my changes
• [] This change is covered by an existing CI test or a new one has been added
• Any new scripts have been added to the .github/CODEOWNERS file with owners
• I have made corresponding changes to the system documentation if necessary

[NeilBarton-NOAA]

GFS forecast tested with archiving changes. New interpolated_zgrid file needed, and is at

gaeac6:/gpfs/f6/sfs-emc/scratch/Neil.Barton/CODE/gw_ocnice_products_NeilBarton-NOAA/fix/interpolate_zgrid_30L.nc

[jiandewang]

by checking 11L native ocean file I found only ssh, mld_003 and layered TSUV are being saved. We need to have SST/SSS as they are the key information users need. Note top layer of temp will not be identical to SST though they will be very close (depends on the vertical remap depth settings)

[DavidHuber-NOAA]

All tests passed on Ursa.

[DavidHuber-NOAA]

@jiandewang I will wait for approval from you before relaunching tests.

[jiandewang]

I checked ocean output, they are fine as expected.

[emcbot]

C96mx100_S2S FAILED on Ursa (pipeline ID: 6067)

In directory: /scratch3/NCEPDEV/global/role.glopara/GFS_CI_CD/URSA/BUILDS/GITLAB/pr_cases_4200_da19eb69_6067/RUNTESTS/EXPDIR/C96mx100_S2S_da19eb69-6067

This failure was detected automatically by global-workflow's CI/CD Pipeline

[DavidHuber-NOAA]

@NeilBarton-NOAA These lines are triggering the arch_tars dependency on the sfs_cleanup task. Since sfs_arch_tars does not exist, this is causing a stall. Can you please set DO_ARCHCOM to NO for now and reinstate these lines on the next PR that enables archiving?

[DavidHuber-NOAA]

@NeilBarton-NOAA Thanks! The SFS cleanup task now runs without issue. Merging.