NGWPC NWM PI-3 Formulation Selection Delivery 2025-11-21#22

Open

cmaynard-ngwpc wants to merge 499 commits into

NOAA-OWP:masterfrom

NGWPC:ngwpc-3.1.2.0.0

This pull request is big! We're only showing the most recent 250 commits

Commits on Apr 17, 2025

Change how lock file is named
peterkronenberg-rtx
committed

Commits on Apr 22, 2025

Correct cleanup
peterkronenberg-rtx
committed
Merge branch 'peter_ngwpc-6093_refactoring_part_2' into 'development'
peterkronenberg-rtx
committed
1) Added the test case to use the t-route Lower Colorado River domain output as the streamflow and HRRR files as atmospheric forcings for SCHISM, 2) Added the coastal pre-processing scripts and par…

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on Apr 23, 2025

Commits on Apr 25, 2025

Merge branch 'NGWPC-1356' into 'development'
zhengtaocui
committed

Commits on Apr 28, 2025

Commits on Apr 29, 2025

Updated the master script and fixed errors in the OWP makeAtmoHRRR.py script. This update enables the full forecase use case workflow to be run successfully.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on May 1, 2025

Merge branch 'NWGWC6145_full_workflow_for_schism_forecast_use_case' into 'development'
zhengtaocui
committed

Commits on May 6, 2025

1)Updated Dockerfile.ngencoastal for OE deployment, 2) Added run script for HRRR data extraction and for the Lower Colorado River ngen simulation. The Lower Colorado River test data should be downl…

Parallel Works app-run user
authored and
Parallel Works app-run user
committed
added updates to nexgen_preprocessing.bash

Parallel Works app-run user
authored and
Parallel Works app-run user
committed
Updated run_forecast_nexgen_preprocessing.bash

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on May 9, 2025

Merge branch 'NGWPC_6146_OE_Deployment' into 'development'
zhengtaocui
committed

Commits on May 10, 2025

Commits on May 13, 2025

Commits on May 15, 2025

1) added new run script for forcing engine BMI and ngen to streamline the streamflow simulations. 2) a few bug fixes, 3) removed scripts for making mesh, extracting forcing and running ngen.
zhengtaocui
committed

Commits on May 16, 2025

SCHISM has a problem when reading the time in sflux_air file when the time valriable is a number with repeating decimals and the number is rounded up. Changed the code to explicitly round the time…
zhengtaocui
committed

Commits on May 20, 2025

Merge branch 'NGWPC_6147' into 'development'
zhengtaocui
committed

Commits on May 22, 2025

added --yes flag to conda clean command in Dockerfile.ngencoastal file
miguelp1986
committed

Commits on May 27, 2025

changes to bmi_wrapper.py to fix standard_ana bug

Kyle Larkin
authored and
Kyle Larkin
committed
Merge branch 'NGWPC-6335_standard_ana_bug' into 'development'
kyle-larkin
committed

Commits on Jun 4, 2025

Commits on Jun 5, 2025

Commits on Jun 11, 2025

Merge branch 'development' into 'release-candidate'
cmaynard-ngwpc
committed

Commits on Jul 9, 2025

Updating LFD for Alaska AORC NetCDF local processing.

Kyle Larkin
authored and
Kyle Larkin
committed

Commits on Jul 10, 2025

Merge branch 'ksl_NGWPC-6839_Alaska_AORC' into 'development'
kyle-larkin
committed

Commits on Jul 14, 2025

Tweaks and a bugfix for zarr batch processing.

Kyle Larkin
authored and
Kyle Larkin
committed
Merge branch 'ksl_NGWPC-6840_AORC_Support' into 'development'
kyle-larkin
committed

Commits on Aug 19, 2025

Commits on Aug 22, 2025

Commits on Aug 23, 2025

Commits on Aug 26, 2025

Commits on Aug 27, 2025

added sfincs forcing time series creation scripts
mkarim-rtx
committed

Commits on Sep 2, 2025

Commits on Sep 3, 2025

Commits on Sep 6, 2025

combining all together
mkarim-rtx
committed

Commits on Sep 9, 2025

Merge pull request #6 from NGWPC/release-candidate
cmaynard-ngwpc
authored

Commits on Sep 11, 2025

Commits on Sep 12, 2025

Commits on Sep 14, 2025

update
mkarim-rtx
committed
update
mkarim-rtx
committed

Commits on Sep 17, 2025

Updated forcing extraction sources to s3
jswade-rtx
committed
Update forcing_extraction and bmi_wrapper to accept input time

jswade-rtx
authored and
kyle-larkin
committed
Modified bmi_wrapper to support modular extraction scheme

jswade-rtx
authored and
kyle-larkin
committed
Add functionality for long_range and standard ana forcing extraction

jswade-rtx
authored and
kyle-larkin
committed
Testing changes for AnA functionality

jswade-rtx
authored and
kyle-larkin
committed
Updated forcing extraction workflow for Alaska and Puerto Rico

jswade-rtx
authored and
kyle-larkin
committed
Added functionality for extended_ana run

jswade-rtx
authored and
kyle-larkin
committed
Continuing integration with nwm-msw-mgr forecast workflow

jswade-rtx
authored and
kyle-larkin
committed
Move esmf_creation to a separate script

jswade-rtx
authored and
kyle-larkin
committed
Move forcing extraction out of bmi_wrapper

jswade-rtx
authored and
kyle-larkin
committed
Updates to forcing_extraction.py for testing

jswade-rtx
authored and
kyle-larkin
committed
Minor fixes for forcing_extration.py after testing

jswade-rtx
authored and
kyle-larkin
committed
Updated forcing extraction sources to s3

jswade-rtx
authored and
kyle-larkin
committed
updates to integrate mesh creation and forcing extraction in FE
kyle-larkin
committed
merging changes to integrate FE modules
kyle-larkin
committed

Commits on Sep 18, 2025

Commits on Sep 19, 2025

Moved config template files into repo
jswade-rtx
committed

Commits on Sep 22, 2025

Update cold_start forcing sources
jswade-rtx
committed

Commits on Sep 23, 2025

1) Merged the download data scripts for both sfincs and schism, 2) updated the configuration to include schism configuratioins.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on Sep 24, 2025

Updated the domain yaml files for schism.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on Sep 25, 2025

fixed import of esmf_creation and forcings_extraction

kyle-larkin
authored and
jswade-rtx
committed

Commits on Sep 26, 2025

Commits on Sep 29, 2025

updated cicd file to avoid unecessary docker pull and docker push commands when tagging latest and release builds
miguelp1986
committed
updated cicd file
miguelp1986
committed
Merge pull request #18 from NGWPC/pena-update-cicd
miguelp1986
authored
Updated data_downloader to skip tpxo downloading.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on Sep 30, 2025

Commits on Oct 1, 2025

removed Testing from directory tree
mkarim-rtx
committed
put back Testing directory
mkarim-rtx
committed
Merge branch 'NWGPC_9695_9692_zcui' into Sfincs-Forcing-Mohammed
mkarim-rtx
committed
removed Testing directory
mkarim-rtx
committed
removed coastalforcing/domain_lists/schism/all.yaml.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed
added missed file
mkarim-rtx
committed
Merge branch 'Sfincs-Forcing-Mohammed' of github.com:NGWPC/ngen-forcing into Sfincs-Forcing-Mohammed
mkarim-rtx
committed
Update SCHISM domain config and folders.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed
Merge pull request #19 from NGWPC/Sfincs-Forcing-Mohammed
zhengtaocui
authored
Cleaned up directory coastal/calib.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on Oct 2, 2025

updated forcing_extraction logic for ana runs
kyle-larkin
committed

Commits on Oct 3, 2025

Updated the path for coastal parameters and the singularity container to be consistent with the setting on the integration cluster. Updated coastal/SFINCS/requirements.txt.

Parallel Works app-run user
authored and
Parallel Works app-run user
committed

Commits on Oct 4, 2025

Fix dockerfile to set Pythonpath
peterkronenberg-rtx
committed

Commits on Oct 6, 2025

Commits on Oct 8, 2025

Commits on Oct 9, 2025

Commits on Oct 14, 2025

added sfincs forcing time series creation scripts

mkarim-rtx
authored and
jswade-rtx
committed
added usescases and glofs

mkarim-rtx
authored and
jswade-rtx
committed
fixing matep issue

mkarim-rtx
authored and
jswade-rtx
committed
mateo update

mkarim-rtx
authored and
jswade-rtx
committed
mateo processing

mkarim-rtx
authored and
jswade-rtx
committed
interploting 600 sec

mkarim-rtx
authored and
jswade-rtx
committed
update on getting noaa output

mkarim-rtx
authored and
jswade-rtx
committed
comparing outputs

mkarim-rtx
authored and
jswade-rtx
committed
combining all together

mkarim-rtx
authored and
jswade-rtx
committed
update

mkarim-rtx
authored and
jswade-rtx
committed
update

mkarim-rtx
authored and
jswade-rtx
committed
removed mistakenly added files

mkarim-rtx
authored and
jswade-rtx
committed
removed mistakenly added files

mkarim-rtx
authored and
jswade-rtx
committed
updated cicd file to avoid unecessary docker pull and docker push commands when tagging latest and release builds

miguelp1986
authored and
jswade-rtx
committed
updated cicd file

miguelp1986
authored and
jswade-rtx
committed
Ngwpc 7425 add scm config and NGWPC 7892 use SFINCS config (#16)

authored and
jswade-rtx
committed
removed Testing from directory tree

mkarim-rtx
authored and
jswade-rtx
committed
put back Testing directory

mkarim-rtx
authored and
jswade-rtx
committed
1) Merged the download data scripts for both sfincs and schism, 2) updated the configuration to include schism configuratioins.

Parallel Works app-run user
authored and
jswade-rtx
committed
Updated the domain yaml files for schism.

Parallel Works app-run user
authored and
jswade-rtx
committed
Updated data_downloader to skip tpxo downloading.

Parallel Works app-run user
authored and
jswade-rtx
committed
removed Testing directory

mkarim-rtx
authored and
jswade-rtx
committed
added missed file

mkarim-rtx
authored and
jswade-rtx
committed
removed coastalforcing/domain_lists/schism/all.yaml.

Parallel Works app-run user
authored and
jswade-rtx
committed
Update SCHISM domain config and folders.

Parallel Works app-run user
authored and
jswade-rtx
committed
Cleaned up directory coastal/calib.

Parallel Works app-run user
authored and
jswade-rtx
committed
Updated the path for coastal parameters and the singularity container to be consistent with the setting on the integration cluster. Updated coastal/SFINCS/requirements.txt.

Parallel Works app-run user
authored and
jswade-rtx
committed
updated SFINCS README and created Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
comment changes to Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
added SFINCS build to CICD pipeline

miguelp1986
authored and
jswade-rtx
committed
updated Dockerfile.sfincs

miguelp1986
authored and
jswade-rtx
committed
cicd file

miguelp1986
authored and
jswade-rtx
committed
updated cicd file

miguelp1986
authored and
jswade-rtx
committed

Commits on Oct 15, 2025

Commits on Oct 16, 2025

fixing logic for supplemental radar forcing_extraction time handling
kyle-larkin
committed

Commits on Oct 17, 2025

Prevent re-running the model when update_until's future_time is equal to the current time
idtodd
committed

Commits on Oct 20, 2025

Merge pull request #26 from NGWPC/forecast_validation_root_dir
kyle-larkin
authored

Commits on Oct 21, 2025

Merge pull request #27 from NGWPC/idt-prevent-rerunning-model-on-same-time
kyle-larkin
authored

Commits on Oct 27, 2025

fixed forcing extraction for ana time handling again
kyle-larkin
committed

Commits on Oct 28, 2025

Commits on Oct 31, 2025

Commits on Nov 4, 2025

Merge pull request #29 from NGWPC/klarkin_ana_times
kyle-larkin
authored

Commits on Nov 12, 2025