Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
ec8269f
add todos
jrknezha Jan 15, 2025
a634d49
update the gitignore for .png
jrknezha Jan 15, 2025
956757b
channels need to be string and ints, need to fix that...
jrknezha Jan 24, 2025
8720c25
channel line plot works
jrknezha Jan 28, 2025
ad135ef
per channel works
jrknezha Feb 3, 2025
106021f
multi stat works
jrknezha Feb 3, 2025
0e554af
comparison works
jrknezha Feb 3, 2025
fa34de3
function detail comments
jrknezha Feb 3, 2025
10d0eb8
updates including code tree path
jrknezha Feb 6, 2025
c181d0a
everything specified through the top level function
jrknezha Feb 11, 2025
2106b03
updated changes
jrknezha Feb 11, 2025
e6d98a9
clean up
jrknezha Feb 11, 2025
be38e9e
some clean up
jrknezha Feb 12, 2025
e5dd231
clear plot titles with all info
jrknezha Feb 14, 2025
0cef34b
automation for time series plot generation of brightness temperature …
amschne Feb 22, 2025
d86f876
MPI support for plotting multiple sensors in parallel
amschne Feb 25, 2025
03a3ef3
added n_obs_tossed to GSI analysis fit to obs plots and improved figu…
amschne Feb 27, 2025
b30a1f0
readability improvements to figures including temporal smoothing and …
amschne Mar 5, 2025
7bbbc89
bug fix for calculation of max obs error
amschne Mar 5, 2025
3674161
interactive plotting with cli options for single satellite, sensor an…
amschne Mar 5, 2025
7176228
add usage to plot background
amschne Mar 7, 2025
e97f641
sbatch script for generating GSI radiance fit to obs figures
amschne Mar 7, 2025
5fe520f
fixes for noninteractive batch jobs
amschne Mar 7, 2025
1701d40
support for O-A statistics and plotting n_obs_used instead of n_obs_t…
amschne Mar 12, 2025
54ab703
mean bias standard error plot update
amschne Mar 14, 2025
0cda8f3
GSI analysis fit to obs figure enhancements with dark theme support
amschne Mar 21, 2025
c260015
Merge branch 'feature/dark_theme' into feature/gsi_radiance_fit_to_obs
amschne Mar 21, 2025
bbeec9d
plt.close() calls for file count and replay increment plot scripts
amschne Mar 24, 2025
645ce21
rename dark_theme.mplstyle
amschne Mar 24, 2025
cece05f
update dark theme mpl_style_sheet name
amschne Mar 27, 2025
9908a87
minor changes for plotting all sensors
amschne Apr 4, 2025
4d12650
replay file count and increment plot readability improvements
amschne Apr 7, 2025
d36628a
increased number of tasks from 12 to 16 for all satellite sensor fit …
amschne Apr 7, 2025
2fa3b12
gsi radiance monitoring plot changes, including increased nominal tex…
amschne Apr 8, 2025
32f2843
python wrapper and sbatch scripts for GSI radiance figures to generat…
amschne Apr 11, 2025
d6f6c0e
Merge branch 'develop' into beta_test/file_counts_replay_inc_gsi_brig…
amschne Apr 22, 2025
2133a8e
new scripts and source code changes to add figure generation for repl…
amschne Apr 24, 2025
1638860
new scripts and source code changes to add figure generation for repl…
amschne Apr 24, 2025
67d5d2c
update environment in sbatch submission scripts
amschne Apr 24, 2025
41f469d
Update font for dark theme figures
amschne Jun 3, 2025
dee3d34
support for the first weakly coupled scout run experiment; also moved…
amschne Jun 13, 2025
99ceeea
corrected MetOp name and added weakly coly coupled scout run to stand…
amschne Jun 26, 2025
3c836a2
sat name corrections
amschne Jun 27, 2025
9c7aa91
Adjusted figure end dates for default plotting scripts
amschne Jul 10, 2025
ad36db2
add timeout to full GSI radiance plotting batch submission script to …
amschne Aug 13, 2025
4b49dd3
batch submission script to launch GSI radiance plotting for individua…
amschne Aug 13, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,4 +2,4 @@
__pycache__
.DS_Store
.vscode/
.png
*.png
1 change: 1 addition & 0 deletions MANIFEST.in
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
include src/score_plotting/style_lib/*.mplstyle
18 changes: 18 additions & 0 deletions batch_scripts/plot_gsi_radiance_fit_to_obs.sbatch
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
#!/bin/bash
#SBATCH --job-name=gsi_radiance_plots # Name of the job
#SBATCH --output=plot_gsi%j.log # Output log file with job ID
#SBATCH --ntasks=16
#SBATCH --ntasks-per-node=16 # Number of tasks (CPUs) per node
#SBATCH --cpus-per-task=2
#SBATCH --nodes=1 # Number of nodes (adjust based on your requirements)
#SBATCH --time=12:00:00 # Max wall time (adjust as needed)
#SBATCH --partition=bigmem #batch # Partition to use
#SBATCH --mail-type=ALL # Send an email when the job starts, ends, or fails
#SBATCH [email protected] # Email address for notifications

source $HOME/.bash_profile
micromamba activate darr_score_sqlalchemy1_dev_env
#which mpirun
# Run the MPI Python script using mpiexec
timeout 21600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs /media/darr/results/figures/brightness_temperature_error_timeseries

18 changes: 18 additions & 0 deletions batch_scripts/plot_gsi_radiance_fit_to_obs_daily_update.sbatch
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
#!/bin/bash
#SBATCH --job-name=gsi_radiance_plots_daily_update # Name of the job
#SBATCH --output=plot_gsi%j.log # Output log file with job ID
#SBATCH --ntasks=12
#SBATCH --ntasks-per-node=12 # Number of tasks (CPUs) per node
#SBATCH --cpus-per-task=2
#SBATCH --nodes=1 # Number of nodes (adjust based on your requirements)
#SBATCH --time=6:00:00 # Max wall time (adjust as needed)
#SBATCH --partition=medmem #batch # Partition to use
#SBATCH --mail-type=ALL # Send an email when the job starts, ends, or fails
#SBATCH [email protected] # Email address for notifications

source $HOME/.bash_profile
micromamba activate darr_score_sqlalchemy1_dev_env
#which mpirun
# Run the MPI Python script using mpiexec
mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs_daily_update /media/darr/results/figures/brightness_temperature_error_timeseries

17 changes: 17 additions & 0 deletions batch_scripts/plot_gsi_radiance_fit_to_obs_rod_overlap.sbatch
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
#!/bin/bash
#SBATCH --job-name=gsi_radiance_plots # Name of the job
#SBATCH --output=plot_gsi%j.log # Output log file with job ID
#SBATCH --ntasks=16
#SBATCH --ntasks-per-node=16 # Number of tasks (CPUs) per node
#SBATCH --cpus-per-task=2
#SBATCH --nodes=1 # Number of nodes (adjust based on your requirements)
#SBATCH --time=48:00:00 # Max wall time (adjust as needed)
#SBATCH --partition=bigmem #batch # Partition to use
#SBATCH --mail-type=ALL # Send an email when the job starts, ends, or fails
#SBATCH [email protected] # Email address for notifications

source $HOME/.bash_profile
micromamba activate darr_score_sqlalchemy1_dev_env
#which mpiexec
# Run the MPI Python script using mpiexec
mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs_rod_overlap.py /media/darr/results/figures/brightness_temperature_error_timeseries_rod_overlap
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
#!/bin/bash
#SBATCH --job-name=gsi_radiance_plots_daily_update # Name of the job
#SBATCH --output=plot_gsi%j.log # Output log file with job ID
#SBATCH --ntasks=12
#SBATCH --ntasks-per-node=12 # Number of tasks (CPUs) per node
#SBATCH --cpus-per-task=2
#SBATCH --nodes=1 # Number of nodes (adjust based on your requirements)
#SBATCH --time=6:00:00 # Max wall time (adjust as needed)
#SBATCH --partition=medmem #batch # Partition to use
#SBATCH --mail-type=ALL # Send an email when the job starts, ends, or fails
#SBATCH [email protected] # Email address for notifications

source $HOME/.bash_profile
micromamba activate darr_score_sqlalchemy1_dev_env
#which mpiexec
# Run the MPI Python script using mpiexec
mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs_rod_overlap_daily_update /media/darr/results/figures/brightness_temperature_error_timeseries_rod_overlap
30 changes: 30 additions & 0 deletions batch_scripts/plot_gsi_radiance_fit_to_obs_serial.sbatch
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
#!/bin/bash
#SBATCH --job-name=gsi_radiance_plots # Name of the job
#SBATCH --output=plot_gsi%j.log # Output log file with job ID
#SBATCH --ntasks=16
#SBATCH --ntasks-per-node=16 # Number of tasks (CPUs) per node
#SBATCH --cpus-per-task=2
#SBATCH --nodes=1 # Number of nodes (adjust based on your requirements)
#SBATCH --time=12:00:00 # Max wall time (adjust as needed)
#SBATCH --partition=bigmem #batch # Partition to use
#SBATCH --mail-type=ALL # Send an email when the job starts, ends, or fails
#SBATCH [email protected] # Email address for notifications

source $HOME/.bash_profile
micromamba activate darr_score_sqlalchemy1_dev_env
#which mpirun
# Run the MPI Python script using mpiexec
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor msu /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor gmi /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor mhs /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor saphir /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor sndr /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor sndrD1 /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor sndrD2 /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor sndrD3 /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor sndrD4 /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor avhrr2 /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor amsre /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor amsr2 /media/darr/results/figures/brightness_temperature_error_timeseries
timeout 3600 mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs --sensor tmi /media/darr/results/figures/brightness_temperature_error_timeseries

Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
#!/bin/bash
#SBATCH --job-name=gsi_radiance_plots # Name of the job
#SBATCH --output=plot_gsi%j.log # Output log file with job ID
#SBATCH --ntasks=16
#SBATCH --ntasks-per-node=16 # Number of tasks (CPUs) per node
#SBATCH --cpus-per-task=2
#SBATCH --nodes=1 # Number of nodes (adjust based on your requirements)
#SBATCH --time=12:00:00 # Max wall time (adjust as needed)
#SBATCH --partition=batch # Partition to use
#SBATCH --mail-type=ALL # Send an email when the job starts, ends, or fails
#SBATCH [email protected] # Email address for notifications

source $HOME/.bash_profile
micromamba activate darr_score_sqlalchemy1_dev_env
#which mpiexec
# Run the MPI Python script using mpiexec
mpiexec python -m score_plotting.core_scripts.plot_gsi_radiance_fit_to_obs_weakly_coupled_scout /media/darr/results/figures/brightness_temperature_error_timeseries_weakly_coupled_scout
4 changes: 2 additions & 2 deletions src/score_plotting/attrs/file_counts_plot_attrs.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@

AxesLabel = namedtuple('AxesLabel', ['axis', 'label', 'horizontalalignment'])

DEFAULT_LEGEND_ATTRS = LegendData(loc='upper left', fancybox=None,
DEFAULT_LEGEND_ATTRS = LegendData(loc='upper right', fancybox=None,
edgecolor=None, framealpha=None, shadow=None,
fontsize='small', facecolor=None)

Expand All @@ -30,6 +30,6 @@
xlabel=DEFAULT_XLABEL,
ylabel=AxesLabel(
axis='y',
label='Number of files',
label=None,
horizontalalignment='center'
))}
2 changes: 1 addition & 1 deletion src/score_plotting/attrs/increments_plot_attrs.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@

AxesLabel = namedtuple('AxesLabel', ['axis', 'label', 'horizontalalignment'])

DEFAULT_LEGEND_ATTRS = LegendData(loc='lower left', fancybox=None,
DEFAULT_LEGEND_ATTRS = LegendData(loc='upper left', fancybox=None,
edgecolor=None, framealpha=None, shadow=None,
fontsize='large', facecolor=None)

Expand Down
Empty file modified src/score_plotting/core_scripts/__init__.py
100644 → 100755
Empty file.
Loading