How to access the 'default' sampling_params of the LLM? #5429
Unanswered
namespace-Pt
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
From my understanding, each model has a default sampling_params specifying the
bos_token_idandeos_token_idjust likeGenerationConfigin huggingface. I cannot find an entry to a defaultsampling_paramsfrom theLLMclass. Can anyone help me? Thanks in advance.Beta Was this translation helpful? Give feedback.
All reactions