How to only download model without serving it? #11524
Unanswered
yardenshoham
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently I run
vllm serve
and look at~/.cache/huggingface
to get the model. I cancelvllm serve
once it started. Is there somevllm pull
command?Beta Was this translation helpful? Give feedback.
All reactions