Skip to content

perf(qwen35): batch eager decode rows under TP (split 2/4 of #946) - #1004

Open
Ma1oneZhang wants to merge 4 commits into
pegainfer-project:mainfrom
Ma1oneZhang:feat/qwen35-tp-batched-decode
Open

perf(qwen35): batch eager decode rows under TP (split 2/4 of #946)#1004
Ma1oneZhang wants to merge 4 commits into
pegainfer-project:mainfrom
Ma1oneZhang:feat/qwen35-tp-batched-decode