perplexity計算時にbosトークンがない場合にeosトークンを代わりに使う#253

Ktakuya332C merged 2 commits intomainsbintuitions/flexeval:mainfrom

fix/logprobs-without-bos-tokensbintuitions/flexeval:fix/logprobs-without-bos-tokenCopy head branch name to clipboard