Skip to content

How to enable embeddings mode #8113

Answered by duongngyn0510
mina58 asked this question in Q&A
Discussion options

You must be logged in to vote

you cannot enable embedding_mode in vLLM because it depends on the model architecture. you can check the models that support embedding_mode in vLLM by looking at _EMBEDDING_MODELS in the vllm/model_executor/models/registry.py file (tag v0.6.6)

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by mgoin
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants