Parsl does not provide a means to trigger downstream tasks when the current, still running, task has produced an output file. Partial completion of tasks cannot trigger completion of data futures. The solution is to create a function or Parsl App that polls for a given file until a customizable condition is met or a timeout is reached. The function would return a future whose result is available once one of those conditions occurs. This would allow for creation of data dependencies in the same vein as what Rocoto's dependencies provides.
Parsl does not provide a means to trigger downstream tasks when the current, still running, task has produced an output file. Partial completion of tasks cannot trigger completion of data futures. The solution is to create a function or Parsl App that polls for a given file until a customizable condition is met or a timeout is reached. The function would return a future whose result is available once one of those conditions occurs. This would allow for creation of data dependencies in the same vein as what Rocoto's dependencies provides.