Automatic Function Calling For CohereForAI/c4ai-command-r-plus-08-2024 #8958
Unanswered
tomer150178
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I deployed the model c4ai-command-r-plus-08-2024 locally based on VLLM.
I would like to enable the Automatic Function Calling feature, so I set the following flags:
--enable-auto-tool-choice
--chat-template [path/to/local/tokenizer_config.json]
As described in the documentation, I need to define another flag: --tool-call-parser, but there is no option for the Command-R-Plus model from Cohere (the available options are: hermes, mistral, or llama3_json).
Could you please help me find a solution for this issue?
Beta Was this translation helpful? Give feedback.
All reactions