How to enable embeddings mode #8113
-
when i use vllm serve i get a log saying that embedding_mode is false. how can i enable it to use the /v1/embedding endpoint. |
Beta Was this translation helpful? Give feedback.
Answered by
duongngyn0510
Jan 9, 2025
Replies: 1 comment
-
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
mgoin
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
you cannot enable
embedding_mode
in vLLM because it depends on the model architecture. you can check the models that supportembedding_mode
in vLLM by looking at_EMBEDDING_MODELS
in thevllm/model_executor/models/registry.py
file (tag v0.6.6)