You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As a result, I am now facing import issues. I would prefer not to refactor the entire codebase and instead resolve this by updating the import statements.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi Team,
I encountered an issue while using the following import statements in my code with vLLM version 0.6.1:
from vllm.entrypoints.openai.rpc.client import AsyncEngineRPCClient
from vllm.entrypoints.openai.rpc.server import run_rpc_server
In the vLLM 0.6.2 release, the vllm.openai.rpc folder was removed. Refer to the sample PR for more details:
https://github.com/vllm-project/vllm/pull/8157/files#diff-6558549c25380c16a3e62d4f151d27f37de101635c626a65ae51bcfd8ef72faf
As a result, I am now facing import issues. I would prefer not to refactor the entire codebase and instead resolve this by updating the import statements.
Could you please suggest a way to achieve this?
Beta Was this translation helpful? Give feedback.
All reactions