dedop_run_scheduler

DeDop automated job scheduler written in bash dedicated to DeDop Core

DeDop is a User Configurable Tool for Processing Delay Doppler Altimeter Data. Please visit this page for more details: https://github.com/DeDop.

About dedop_run_scheduler

The dedop_run_scheduler script is intended to work with dedop-core.

What can do dedop_run_scheduler:

• Run one dedop job per input netCDF file and several jobs in parallel.

• Automate the scheduling of parallel dedop jobs up to a limit defined by the user OR computed from the number of logical CPUs of the running machine. Run a new job each time another one terminates, until no more files are to be processed.

• By default, run on the "current" user's workspace input files, using the "current" workspace's configuration.

• Optionally ignore the processing if output file(s) already existing, honouring =dedop run= '-s' option.

• Automatically kill dedop jobs that have been running for too long (workaround an infinite loop bug in dedop-core versions <=1.1.0).

Since dedop_run_scheduler uses the CLI interface of DeDop Core, all versions are normally supported (including bundled package of dedop-core v1.5.0).

Installation

1. Clone this repository in some folder on your local machine.

2. Add this folder to your PATH environment variable.

3. Ensure that the following files have the executable bit set:

   dedop_run_scheduler libdedop

   Note: dedop_run_scheduler requires that libdedop is also in your PATH, this is normally the case when steps 1. and 2. have been done properly.

Documentation

The documentation of the dedop_run_scheduler is embed as commented text in the script itself. It can be printed from the shell command line:

dedop_run_scheduler -h

Usage examples

1. Run on the "current" user's workspace input files, using the "current" workspace's configuration:

   dedop_run_scheduler

Authors

Nicolas Bercher, Along-Track SAS, 2019.

Licence

The bash scripts in this repository are licensed under the terms of the GPLv2 licence.