Skip to content

Commit 402d208

Browse files
dthainbenclifford
andauthored
TaskVine executor: add parsl serialize module to default library context (#3902)
# Description This improves task throughput for taskvine serverless by caching the serialize module and base function definition in the library. # Changed Behaviour All workflows using TaskVine # Fixes Minor update to PR #3604 ## Type of change Choose which options apply, and delete the ones which do not apply. - Performance improvement FYI @colinthomas-z80 @benclifford --------- Co-authored-by: Ben Clifford <[email protected]>
1 parent 012cfba commit 402d208

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

parsl/executors/taskvine/manager.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,7 @@
66
import subprocess
77
import uuid
88

9+
import parsl
910
from parsl.executors.taskvine import exec_parsl_function
1011
from parsl.executors.taskvine.utils import VineTaskToParsl, run_parsl_function
1112
from parsl.process_loggers import wrap_with_logs
@@ -255,7 +256,8 @@ def _taskvine_submit_wait(ready_task_queue=None,
255256
run_parsl_function,
256257
poncho_env=poncho_env_path,
257258
init_command=manager_config.init_command,
258-
add_env=add_env)
259+
add_env=add_env,
260+
hoisting_modules=[parsl.serialize, run_parsl_function])
259261

260262
# Configure the library if provided
261263
if manager_config.library_config:

0 commit comments

Comments
 (0)