Skip to content

perf(rollout): reuse filtered prompt token ids - #2309

Closed
liuhao-labs wants to merge 1 commit into
THUDM:mainfrom
liuhao-labs:fix/1111-cache-filtered-prompt-ids
Closed

liuhao-labs wants to merge 1 commit into
THUDM:mainfrom
liuhao-labs:fix/1111-cache-filtered-prompt-ids

Commits

  1. Commits on Oct 9, 2026