Skip to content

Commit 597b7aa

Browse files
committed
[fix] fix profile run
1 parent b499a03 commit 597b7aa

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

fastdeploy/worker/gpu_model_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1781,7 +1781,7 @@ def _dummy_run(
17811781

17821782
while True:
17831783
# 1. Initialize forward meta and attention meta data
1784-
self._prepare_inputs()
1784+
self._prepare_inputs(is_profiling=True)
17851785

17861786
# 2. Padding inputs for cuda graph
17871787
self.forward_meta.step_use_cudagraph = in_capturing and self.forward_meta.step_use_cudagraph

0 commit comments

Comments
 (0)