feat: support KV cache CPU offloading in vLLM#269

qinganrice wants to merge 1 commit into

ovg-project:mainovg-project/kvcached:mainfrom

qinganrice:feat/cpu_offloadingqinganrice/kvcached:feat/cpu_offloadingCopy head branch name to clipboard