Merge latest mr for main. #2

csy0225 · 2025-09-01T03:16:00Z

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: wangyafeng <[email protected]>

…nse (vllm-project#22960) Signed-off-by: Chen Zhang <[email protected]>

…llm-project#23599) Signed-off-by: Chen Zhang <[email protected]>

…t NFP4 + FP8 MoEs (vllm-project#22674) Signed-off-by: Dipika Sikka <[email protected]> Signed-off-by: Dipika <[email protected]>

Signed-off-by: Kunshang Ji <[email protected]>

Signed-off-by: Jee Jee Li <[email protected]>

…project#23528) Signed-off-by: rongfu.leng <[email protected]>

…#23018) Signed-off-by: DarkLight1337 <[email protected]>

Signed-off-by: Kunshang Ji <[email protected]>

…t#23715) Signed-off-by: DarkLight1337 <[email protected]>

Signed-off-by: windsonsea <[email protected]>

Signed-off-by: Woosuk Kwon <[email protected]>

Signed-off-by: Jee Jee Li <[email protected]>

…22500) Signed-off-by: Fanli Lin <[email protected]> Signed-off-by: Fanli Lin <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Signed-off-by: windsonsea <[email protected]>

Signed-off-by: tc-mb <[email protected]> Signed-off-by: Xin Yang <[email protected]> Signed-off-by: Abatom <[email protected]> Signed-off-by: chzhang <[email protected]> Signed-off-by: Pate Motter <[email protected]> Signed-off-by: Terrencezzj <[email protected]> Signed-off-by: Woosuk Kwon <[email protected]> Signed-off-by: simon-mo <[email protected]> Signed-off-by: mgoin <[email protected]> Signed-off-by: Siyuan Fu <[email protected]> Signed-off-by: siyuanf <[email protected]> Signed-off-by: Weiliang Liu <[email protected]> Signed-off-by: Michael Goin <[email protected]> Signed-off-by: yewentao256 <[email protected]> Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: Luka Govedič <[email protected]> Signed-off-by: Zijing Liu <[email protected]> Signed-off-by: Zijing Liu <[email protected]> Signed-off-by: jiabin.00 <[email protected]> Signed-off-by: zjy0516 <[email protected]> Signed-off-by: Harry Mellor <[email protected]> Signed-off-by: Jee Jee Li <[email protected]> Signed-off-by: tc-mb <[email protected]> Signed-off-by: Roger Wang <[email protected]> Signed-off-by: Roger Wang <[email protected]> Signed-off-by: Huy Do <[email protected]> Signed-off-by: Matúš Námešný <[email protected]> Signed-off-by: Guillaume Calmettes <[email protected]> Signed-off-by: Chen Zhang <[email protected]> Signed-off-by: oye93 <[email protected]> Signed-off-by: Julien Lin <[email protected]> Signed-off-by: Didier Durand <[email protected]> Signed-off-by: Tianyu Li <[email protected]> Signed-off-by: Hongxia Yang <[email protected]> Signed-off-by: Yuekai Zhang <[email protected]> Signed-off-by: vllmellm <[email protected]> Signed-off-by: jiang1.li <[email protected]> Signed-off-by: Zerohertz <[email protected]> Signed-off-by: Hyogeun Oh (오효근) <[email protected]> Signed-off-by: Thomas Parnell <[email protected]> Signed-off-by: Russell Bryant <[email protected]> Signed-off-by: Isotr0py <[email protected]> Signed-off-by: Huzaifa Sidhpurwala <[email protected]> Signed-off-by: Federico <[email protected]> Signed-off-by: Zixuan Zhang <[email protected]> Signed-off-by: wuhang <[email protected]> Signed-off-by: czhu-cohere <[email protected]> Signed-off-by: Wei Wei <[email protected]> Signed-off-by: Yiheng Xu <[email protected]> Signed-off-by: Chenheli Hua <[email protected]> Signed-off-by: wangyafeng <[email protected]> Co-authored-by: Xin Yang <[email protected]> Co-authored-by: Wentao Ye <[email protected]> Co-authored-by: Zhonghua Deng <[email protected]> Co-authored-by: Chaojun Zhang <[email protected]> Co-authored-by: Pate Motter <[email protected]> Co-authored-by: Terrence Zhao <[email protected]> Co-authored-by: Woosuk Kwon <[email protected]> Co-authored-by: Simon Mo <[email protected]> Co-authored-by: Michael Goin <[email protected]> Co-authored-by: weiliang <[email protected]> Co-authored-by: Siyuan Fu <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Cyrus Leung <[email protected]> Co-authored-by: Copilot <[email protected]> Co-authored-by: ProExpertProg <[email protected]> Co-authored-by: Luka Govedič <[email protected]> Co-authored-by: Zijing Liu <[email protected]> Co-authored-by: Bin Jia <[email protected]> Co-authored-by: Jiangyun Zhu <[email protected]> Co-authored-by: Harry Mellor <[email protected]> Co-authored-by: Raghavan <[email protected]> Co-authored-by: Jee Jee Li <[email protected]> Co-authored-by: Cyrus Leung <[email protected]> Co-authored-by: Roger Wang <[email protected]> Co-authored-by: Roger Wang <[email protected]> Co-authored-by: knlnguyen1802 <[email protected]> Co-authored-by: Huy Do <[email protected]> Co-authored-by: Matúš Námešný <[email protected]> Co-authored-by: Guillaume Calmettes <[email protected]> Co-authored-by: Chen Zhang <[email protected]> Co-authored-by: En Ouyang <[email protected]> Co-authored-by: Li, Jiang <[email protected]> Co-authored-by: nvjullin <[email protected]> Co-authored-by: Didier Durand <[email protected]> Co-authored-by: TianyuLi0 <[email protected]> Co-authored-by: Hongxia Yang <[email protected]> Co-authored-by: Yuekai Zhang <[email protected]> Co-authored-by: vllmellm <[email protected]> Co-authored-by: Hyogeun Oh (오효근) <[email protected]> Co-authored-by: Thomas Parnell <[email protected]> Co-authored-by: Russell Bryant <[email protected]> Co-authored-by: Lukas Geiger <[email protected]> Co-authored-by: Isotr0py <[email protected]> Co-authored-by: Huzaifa Sidhpurwala <[email protected]> Co-authored-by: Federico <[email protected]> Co-authored-by: zixuanzhang226 <[email protected]> Co-authored-by: wuhang <[email protected]> Co-authored-by: yzds <[email protected]> Co-authored-by: hongchao <[email protected]> Co-authored-by: czhu-cohere <[email protected]> Co-authored-by: Wei <[email protected]> Co-authored-by: Yiheng Xu <[email protected]> Co-authored-by: Aaron Pham <[email protected]> Co-authored-by: Chenheli Hua <[email protected]> Co-authored-by: CSWYF3634076 <[email protected]>

…vllm-project#23718) Signed-off-by: cndoit18 <[email protected]>

…py` (vllm-project#23127) Signed-off-by: Nick Hill <[email protected]>

…ased models (vllm-project#23716) Signed-off-by: Thomas Parnell <[email protected]>

Signed-off-by: DarkLight1337 <[email protected]>

…3746) Signed-off-by: rebel-hongseok <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Signed-off-by: Harry Mellor <[email protected]>

Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: Cyrus Leung <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Signed-off-by: Harry Mellor <[email protected]>

…roject#23666) Signed-off-by: yewentao256 <[email protected]> Signed-off-by: youkaichao <[email protected]> Co-authored-by: youkaichao <[email protected]>

Signed-off-by: Isotr0py <[email protected]>

…llm-project#23755) Signed-off-by: Didier Durand <[email protected]>

…ect#23362) Signed-off-by: Nick Hill <[email protected]>

…23770) Signed-off-by: Nick Hill <[email protected]>

…ag (vllm-project#23942) Signed-off-by: vllmellm <[email protected]>

Signed-off-by: hongchao <[email protected]> Signed-off-by: Richard Zou <[email protected]> Co-authored-by: hongchao <[email protected]> Co-authored-by: Richard Zou <[email protected]> Co-authored-by: Richard Zou <[email protected]>

…-project#23904) Signed-off-by: 22quinn <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

…roject#23939) Signed-off-by: mgoin <[email protected]>

…ed models (vllm-project#23824) Signed-off-by: Thomas Parnell <[email protected]>

Signed-off-by: Yong Hoon Shin <[email protected]>

) Signed-off-by: Harry Mellor <[email protected]>

Signed-off-by: Roger Wang <[email protected]>

…roject#23944) Signed-off-by: Jean-Francois Dube <[email protected]> Co-authored-by: Jean-Francois Dube <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Signed-off-by: Xin Yang <[email protected]> Co-authored-by: Michael Goin <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Signed-off-by: Roger Wang <[email protected]>

…usion (vllm-project#23973) Signed-off-by: Yong Hoon Shin <[email protected]> Co-authored-by: Roger Wang <[email protected]>

Signed-off-by: DarkLight1337 <[email protected]>

…ject#23831) Signed-off-by: Thomas Parnell <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Signed-off-by: Jee Jee Li <[email protected]>

…-project#23843)

Signed-off-by: zjy0516 <[email protected]> Signed-off-by: Jiangyun Zhu <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

…23971) Signed-off-by: sadeghja1070 <[email protected]> Signed-off-by: Jee Jee Li <[email protected]> Co-authored-by: Claude <[email protected]> Co-authored-by: Jee Jee Li <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Signed-off-by: Andy Xie <[email protected]>

…finally (vllm-project#23758) Signed-off-by: Andy Xie <[email protected]>

Signed-off-by: Andy Xie <[email protected]>

Signed-off-by: Andy Lo <[email protected]> Co-authored-by: Jee Jee Li <[email protected]>

Signed-off-by: Gabriel Marinho <[email protected]> Signed-off-by: Gabriel Marinho <[email protected]> Signed-off-by: Max de Bayser <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Max de Bayser <[email protected]>

…entifiers. (vllm-project#23394) Signed-off-by: Roger Wang <[email protected]>

Signed-off-by: Didier Durand <[email protected]>

Signed-off-by: Roger Wang <[email protected]> Signed-off-by: Roger Wang <[email protected]> Co-authored-by: Roger Wang <[email protected]> Co-authored-by: Roger Wang <[email protected]>

Signed-off-by: Nick Hill <[email protected]>

Signed-off-by: Or Ozeri <[email protected]>

github-actions · 2025-09-01T03:16:07Z

👋 Hi! Thank you for contributing to the vLLM project.

💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels.

Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run fastcheck CI which starts running only a small and essential subset of CI tests to quickly catch errors.

You ask your reviewers to trigger select CI tests on top of fastcheck CI.

Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging.

To run CI, PR reviewers can either: Add ready label to the PR or enable auto-merge.

If you have any questions, please reach out to us on Slack at https://slack.vllm.ai.

🚀

CSWYF3634076 and others added 30 commits August 26, 2025 21:02

[Model] Add Ernie4.5 VL Model Support (vllm-project#22514)

644d57d

Signed-off-by: wangyafeng <[email protected]>

[Frontend] Add --log-error-stack to print stack trace for error respo…

3210264

…nse (vllm-project#22960) Signed-off-by: Chen Zhang <[email protected]>

[Frontend] Optimize beam search performance by limiting concurrency (v…

142ac08

…llm-project#23599) Signed-off-by: Chen Zhang <[email protected]>

[Quantization] Expand compressed-tensors MoE matching logic to suppor…

d272415

…t NFP4 + FP8 MoEs (vllm-project#22674) Signed-off-by: Dipika Sikka <[email protected]> Signed-off-by: Dipika <[email protected]>

[XPU] Add xpu torch.compile support (vllm-project#22609)

fce10db

Signed-off-by: Kunshang Ji <[email protected]>

[CI/Build] Remove redundant LoRA model tests (vllm-project#23706)

9de25c2

Signed-off-by: Jee Jee Li <[email protected]>

[Bugfix] fix when config.yaml config value is list parse error (vllm-…

8dbf6ed

…project#23528) Signed-off-by: rongfu.leng <[email protected]>

[Core] Use key-only cache for BaseMultiModalProcessor (vllm-project…

69244e6

…#23018) Signed-off-by: DarkLight1337 <[email protected]>

[XPU]fix cuda event used in XPU model runner (vllm-project#23708)

6446677

Signed-off-by: Kunshang Ji <[email protected]>

[CI/Build] Remove redundant register in model init tests (vllm-projec…

91e382c

…t#23715) Signed-off-by: DarkLight1337 <[email protected]>

[Docs] Fix an admonition important (vllm-project#23726)

5bd9f84

Signed-off-by: windsonsea <[email protected]>

Optimize input preparation for FlashInfer [2/N] (vllm-project#23174)

6578e87

Signed-off-by: Woosuk Kwon <[email protected]>

[Misc] Move CpuGpuBuffer to vllm/v1/utils.py (vllm-project#23728)

04ff1e4

Signed-off-by: Woosuk Kwon <[email protected]>

[FlashInfer] Cache hyper params in metadata builder (vllm-project#23732)

11eddf0

Signed-off-by: Woosuk Kwon <[email protected]>

[CI/Build] Reduce LoRA layer test cases (vllm-project#23721)

e039407

Signed-off-by: Jee Jee Li <[email protected]>

[XPU] Fix OOM issue for data parallel with Ray backend (vllm-project#…

8f0d7ea

…22500) Signed-off-by: Fanli Lin <[email protected]> Signed-off-by: Fanli Lin <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

[Docs] Fix a 1-2-3 list and style issues in tpu.md (vllm-project#23729)

1f7a9c9

Signed-off-by: windsonsea <[email protected]>

[Bugfix] Fix task field initialization when PYTHONOPTIMIZE is enabled (…

8c13820

…vllm-project#23718) Signed-off-by: cndoit18 <[email protected]>

[Misc] Remove unnecessary _send_reconfig_message() in `core_client.…

a403d0f

…py` (vllm-project#23127) Signed-off-by: Nick Hill <[email protected]>

[V1] [Hybrid] Disable prefix caching by default for hybrid or mamba-b…

704432a

…ased models (vllm-project#23716) Signed-off-by: Thomas Parnell <[email protected]>

[Model] Explicit default_pooling_type interface (vllm-project#23736)

5eeef1b

Signed-off-by: DarkLight1337 <[email protected]>

Add vLLM Korea Meetup in the README.md and meetups.md (vllm-project#2…

8dd2baa

…3746) Signed-off-by: rebel-hongseok <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Fix pre-commit on main (vllm-project#23747)

16dc405

Signed-off-by: Harry Mellor <[email protected]>

[Model] Interface to enable batch-level DP support (vllm-project#23733)

fe8d7b6

Signed-off-by: DarkLight1337 <[email protected]> Signed-off-by: Cyrus Leung <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Only run get_attr_docs if generating help text (vllm-project#23723)

513c1fe

Signed-off-by: Harry Mellor <[email protected]>

[Feature] Add Hopper DeepGEMM E8M0 for DeepSeekV3.1 scale_fmt (vllm-p…

3af47c3

…roject#23666) Signed-off-by: yewentao256 <[email protected]> Signed-off-by: youkaichao <[email protected]> Co-authored-by: youkaichao <[email protected]>

[Model] Enable native HF format InternVL support (vllm-project#23742)

8414904

Signed-off-by: Isotr0py <[email protected]>

[Doc]: upgrade version of crate-ci tool for improved typo detection (v…

83f555f

…llm-project#23755) Signed-off-by: Didier Durand <[email protected]>

[LogitsProcs] Deduplicate built-in LP implementation logic (vllm-proj…

3ce8285

…ect#23362) Signed-off-by: Nick Hill <[email protected]>

njhill and others added 29 commits August 29, 2025 08:17

[BugFix] Async scheduling and PP compatibility with DP (vllm-project#…

d90d8eb

…23770) Signed-off-by: Nick Hill <[email protected]>

[CI] Add aiter to matching list of issue auto labeller for rocm t…

72a6913

…ag (vllm-project#23942) Signed-off-by: vllmellm <[email protected]>

[RL][BugFix] Fix missing tokenizer error for token-in-token-out (vllm…

4d7fe40

…-project#23904) Signed-off-by: 22quinn <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Tuned H100/H200 triton fp8 block configs for fused_qkv_a_proj (vllm-p…

b7adf94

…roject#23939) Signed-off-by: mgoin <[email protected]>

[Docs] [V1] [Hybrid] Add new documentation re: contributing mamba-bas…

1c26b42

…ed models (vllm-project#23824) Signed-off-by: Thomas Parnell <[email protected]>

Revert gemma3n fast prefill changes (vllm-project#23897)

8c3e199

Signed-off-by: Yong Hoon Shin <[email protected]>

[Misc] Make download_weights_from_hf more reliable (vllm-project#23863

5674a40

) Signed-off-by: Harry Mellor <[email protected]>

[CI] Fix unavailable image remote URL (vllm-project#23966)

d660c98

Signed-off-by: Roger Wang <[email protected]>

[Bugfix] Fix --config arg expansion called from api_server.py (vllm-p…

5b31cb1

…roject#23944) Signed-off-by: Jean-Francois Dube <[email protected]> Co-authored-by: Jean-Francois Dube <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

Add routed_scaling_factor to MoE grouped topk (vllm-project#23123)

8fb85b7

Signed-off-by: Xin Yang <[email protected]> Co-authored-by: Michael Goin <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

[CI] Move testing image from remote URL to S3 (vllm-project#23980)

ee52a32

Signed-off-by: Roger Wang <[email protected]>

[CI] Fix broken compile tests due to unsupported SiluMul+Nvfp4Quant f…

9748c51

…usion (vllm-project#23973) Signed-off-by: Yong Hoon Shin <[email protected]> Co-authored-by: Roger Wang <[email protected]>

[Core] Cleanup TPU model runner for MM (vllm-project#23894)

f1bddbd

Signed-off-by: DarkLight1337 <[email protected]>

[V1] [Hybrid] Move MiniMaxLinearAttention into layers/mamba (vllm-pro…

4071c76

…ject#23831) Signed-off-by: Thomas Parnell <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

[Bugfix] Fix test_lora_resolvers.py (vllm-project#23984)

628d00c

Signed-off-by: Jee Jee Li <[email protected]>

[UT] fix unify_kv_cache_configs when kv cache config needs sort (vllm…

5490d63

…-project#23843)

[Model] Enable encoder DP for MiniCPM-V (vllm-project#23948)

3a6acad

Signed-off-by: zjy0516 <[email protected]> Signed-off-by: Jiangyun Zhu <[email protected]> Co-authored-by: Cyrus Leung <[email protected]>

[Misc] add reorder_batch AttentionMetadataBuilder (vllm-project#23798)

fb4983e

Signed-off-by: Andy Xie <[email protected]>

[Refactor] refactor freezing_value/cuda_event initialize outside try …

e80bca3

…finally (vllm-project#23758) Signed-off-by: Andy Xie <[email protected]>

[Misc] enhance type hint for rearrange return value (vllm-project#23519)

68a3491

Signed-off-by: Andy Xie <[email protected]>

[LoRA] Much faster startup when LoRA is enabled (vllm-project#23777)

038e9be

Signed-off-by: Andy Lo <[email protected]> Co-authored-by: Jee Jee Li <[email protected]>

[Core][Multimodal] Allow passing multi_modal_uuids as multimodal id…

749be00

…entifiers. (vllm-project#23394) Signed-off-by: Roger Wang <[email protected]>

[Doc]: fix typos in Python comments (vllm-project#24001)

9701352

Signed-off-by: Didier Durand <[email protected]>

vllm fix check on max vocab size (vllm-project#22471)

81eea3d

Signed-off-by: Roger Wang <[email protected]> Signed-off-by: Roger Wang <[email protected]> Co-authored-by: Roger Wang <[email protected]> Co-authored-by: Roger Wang <[email protected]>

[Minor] Fix some random typos in comments (vllm-project#24009)

752d2e1

Signed-off-by: Nick Hill <[email protected]>

v1: Support KV events from connectors (vllm-project#19737)

14b4326

Signed-off-by: Or Ozeri <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Merge latest mr for main. #2

Merge latest mr for main. #2

Uh oh!

csy0225 commented Sep 1, 2025 •

edited by github-actions bot

Loading

Uh oh!

github-actions bot commented Sep 1, 2025

Uh oh!

Uh oh!

Merge latest mr for main. #2

Are you sure you want to change the base?

Merge latest mr for main. #2

Uh oh!

Conversation

csy0225 commented Sep 1, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

github-actions bot commented Sep 1, 2025

Uh oh!

Uh oh!

csy0225 commented Sep 1, 2025 •

edited by github-actions bot

Loading