How can I give top-p and top-k using grpc connection? #675
Unanswered
Wonder-donbury
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I've been reading the examples for the grpc interaction, and it seems like the ones that access triton server through grpc doesn't have arguments for top-p and top-k. Does anybody know how to pass those arguments to the triton server? Thanks.
Beta Was this translation helpful? Give feedback.
All reactions