Skip to content

YAMLs and Python script for the GOES CSR BUFR#61

Open
PraveenKumar-NOAA wants to merge 2 commits intodevelopfrom
feature/obs_builder_gsrcsr
Open

YAMLs and Python script for the GOES CSR BUFR#61
PraveenKumar-NOAA wants to merge 2 commits intodevelopfrom
feature/obs_builder_gsrcsr

Conversation

@PraveenKumar-NOAA
Copy link
Copy Markdown
Contributor

@PraveenKumar-NOAA PraveenKumar-NOAA commented Aug 1, 2025

This PR introduces the following files for the GSR CSR BUFR converter:

  • ~/dump/mapping/bufr_gsrcsr.yaml
  • ~/dump/mapping/bufr_gsrcsr.py
  • ~/ush/test/config/bufr_bufr4backend_gsrcsr.yaml
  • ~/ush/test/config/bufr_script4backend_gsrcsr.yaml

Testing and Validation

All four workflows (bufr2netcdf, bufr4backend, script2netcdf, and script4backend) were executed and tested using serial execution.

Validation tests were completed for the following variables:

-- satelliteZenithAngle
-- cloudFree
-- brightnessTemperature (Min and Max values are not matching with BUFR, looking at GSI file and debugging it, for details look at the issue #57)

The validation was performed by comparing the input BUFR files and the corresponding output IODA files. Additional details can be found in #57.

Python Coding Standards:

The spoc_python_coding_norms test was run to check compliance with Pycodestyle standards.
The following tests passed:
spoc_python_coding_norms

100% tests passed, 0 tests failed out of 1

Variable Naming Validation:
The following two variables need to be added to the variable naming table (a discussion is needed for these):

Variable MetaData/brightnessTemperaturePercentConfidence
ERROR: Variable 'MetaData/brightnessTemperaturePercentConfidence' is not listed in the YAML conventions file.
Variable MetaData/sensorBandWidth
ERROR: Variable 'MetaData/sensorBandWidth' is not listed in the YAML conventions file.

@PraveenKumar-NOAA PraveenKumar-NOAA changed the base branch from develop to feature/obs_builder August 2, 2025 00:46
Copy link
Copy Markdown
Contributor

@nicholasesposito nicholasesposito left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one comment but the rest looks good.

longName: "Brightness Temperature"
units: "K"

- name: "ObsValue/brightnessTemperatureStandardDeviation"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Curious if this is an ObsValue? Thinking this would be better in MetaData but I'm open to discussing it.

@PraveenKumar-NOAA PraveenKumar-NOAA marked this pull request as ready for review August 28, 2025 13:29
@PraveenKumar-NOAA
Copy link
Copy Markdown
Contributor Author

@emilyhcliu I have created brightnessTemperature plots for the g16 and g17 channels and added to the following isses -- #57.

Base automatically changed from feature/obs_builder to develop September 18, 2025 21:29
HyundeokChoi-NOAA added a commit that referenced this pull request Apr 7, 2026
…m Praveen.Kumar (#101)

This PR have 2 updates.
1. Enable extraction of redistribution‑restriction metadata by adding
restrictionFlag (RSRD) and restrictionExpiration (EXPRSRD) to the
BUFR→IODA conversion. This ensures downstream restriction‑filter logic
has the required fields available in MetaData.
2. Add modified IODA-Converters that originally from Praveen in PRs
(#45, #55, #61, #62, #69).

---------

Co-authored-by: hyundeok choi <[email protected]>
Co-authored-by: hyundeok choi <[email protected]>
Co-authored-by: Cory Martin <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: hyundeok choi <[email protected]>
Co-authored-by: hyundeok choi <[email protected]>
Co-authored-by: hyundeok choi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants