Use vLLM with custom LLM for classification #12176
Unanswered
gadregayatri
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
Is there any way to use vLLM with a custom LLM? It is basically a model modified to add more classification heads as the intention is to use this for a classification task.
Beta Was this translation helpful? Give feedback.
All reactions