Skip to content

Commit d613e22

Browse files
authored
[bugfix]adapt vllm0.9.1 (#446)
adapt vllm0.9.1
1 parent 2663929 commit d613e22

File tree

1 file changed

+1
-4
lines changed

1 file changed

+1
-4
lines changed

ucm/integration/vllm/ucm_connector.py

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -341,10 +341,7 @@ def build_connector_meta(
341341
)
342342
else:
343343
for request in scheduled_cached_reqs:
344-
request_id = request.request_id
345-
if scheduler_output.num_scheduled_tokens[request_id] == 1:
346-
# decode stage
347-
continue
344+
request_id = request.req_id
348345
req_meta = self.requests_meta.get(request_id)
349346
if req_meta:
350347
requests_dispatch_meta[request_id] = self._generate_dispatch_meta(

0 commit comments

Comments
 (0)