[perf] replace all_reduce for kv_consumer and support different num_tokens among all ranks#4736

linfeng-yuan wants to merge 6 commits intovllm-project:mainvllm-project/vllm-ascend:mainfrom

linfeng-yuan:replace_all_reducelinfeng-yuan/vllm-ascend:replace_all_reduceCopy head branch name to clipboard