How did you calculate perplexity using vLLM

[mrtpk]

Hi @krishnateja95,

Thank you for publishing this fantastic work. Please help me understand how you calculated perplexity using vLLM on A100 (fig 10 in your paper).

Thanks.