Skip to content

feat: mixed prefill-decode batching (part 3: compatibility with speculative decoding for MLA models)#205

Merged
syuoni merged 19 commits into
lightseekorg:mainfrom
syuoni:feat/k2.5-mixed-batch
May 23, 2026
Merged

feat: mixed prefill-decode batching (part 3: compatibility with speculative decoding for MLA models)#205
syuoni merged 19 commits into
lightseekorg:mainfrom
syuoni:feat/k2.5-mixed-batch

Commits

Commits on May 23, 2026