Replies: 1 comment 1 reply
-
|
If I remember correctly, installing vllm first and then installing flashinfer will avoid torch conflict. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Why does the release of vllm enforce a binding to a specific, precise version of torch, rather than something like >2.4.0? Moreover, each new version raises the mandatory torch version. This poses significant compatibility challenges. I'm very curious to understand, is it because each version leverages the latest features of torch? |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Installing FlashInfer automatically installs Torch 2.4, while installing VLLM automatically installs Torch 2.5.1. It's quite frustrating.
Beta Was this translation helpful? Give feedback.
All reactions