Skip to content

Pull requests: vllm-project/vllm

New pull request New
440 Open 4,931 Closed
440 Open 4,931 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[v1] fix compilation cache
#11598 opened Dec 29, 2024 by youkaichao Loading…
1
[v1][bugfix] fix cudagraph with inplace buffer assignment ready ONLY add when PR is ready to merge/full CI is needed
#11596 opened Dec 29, 2024 by youkaichao Loading…
8
[Docker] bump up neuron sdk v2.21 ci/build
#11593 opened Dec 29, 2024 by liangfu Loading…
1
1
[V1] 7/N API Server: Update LM-Eval To Use Streaming ci/build
#11590 opened Dec 28, 2024 by robertgshaw2-neuralmagic Loading…
2
[Kernel] Triton Configs for Fp8 Block Quantization
#11589 opened Dec 28, 2024 by robertgshaw2-neuralmagic Loading…
1
[V1] [6/N] API Server: Better Shutdown frontend
#11586 opened Dec 28, 2024 by robertgshaw2-neuralmagic Loading…
@simon-mo @WoosukKwon
4
[Bugfix] Reduce prefix prefill block size for Pascal
#11584 opened Dec 28, 2024 by sasha0552 Loading…
1
[misc] Add LoRA kernel micro benchmarks
#11579 opened Dec 28, 2024 by varun-sundar-rabindranath Loading…
2
[WIP][Model] Initialize support for Deepseek-VL2 models frontend needs-rebase
#11578 opened Dec 28, 2024 by Isotr0py • Draft
1
2
[Misc] Minimum requirements for SageMaker compatibility ci/build frontend
#11576 opened Dec 28, 2024 by nathan-az Loading…
1
14
[Draft] Update benchmark_moe.py to use block wise quant for Deepseek V3
#11574 opened Dec 28, 2024 by simon-mo • Draft
3
[benchmark] Remove dependency for H100 benchmark step ci/build
#11572 opened Dec 27, 2024 by khluu Loading…
1
[Frontend] Improve Error Handling documentation Improvements or additions to documentation frontend needs-rebase
#11570 opened Dec 27, 2024 by robertgshaw2-neuralmagic Loading…
2
[Bugfix] Move the _touch(computed_blocks) call in the allocate_slots method to after the check for allocating new blocks.
#11565 opened Dec 27, 2024 by sakunkun Loading…
1
8
[Model] LoRA with lm_head and embed_tokens fully trained - 3
#11558 opened Dec 27, 2024 by sergeykochetkov Loading…
1
[Misc]Minor Changes about Worker
#11555 opened Dec 27, 2024 by noemotiovon Loading…
1
[Frontend] [Bugfix] Refactor tool parsers and simplify the tool parsing interface. ci/build frontend
#11554 opened Dec 27, 2024 by elementary-particle • Draft
1
1
[Misc] Speculative Decoding: Adding Mean Accept Length Metric
#11552 opened Dec 27, 2024 by MMuzzammil1 Loading…
6
Bounded peak memory in Top-P-Top-K with chunked sorting ci/build
#11544 opened Dec 27, 2024 by yangalan123 Loading…
1
@robertgshaw2-neuralmagic
4
[Benchmark] Add benchmark script for CPU offloading ready ONLY add when PR is ready to merge/full CI is needed
#11533 opened Dec 26, 2024 by ApostaC Loading…
@comaniac
1
[Core] Block Allocator to support KV cache CPU offloading frontend ready ONLY add when PR is ready to merge/full CI is needed
#11532 opened Dec 26, 2024 by ApostaC Loading…
1
[Core] Performance optimization for swap_blocks by cuda kernels ready ONLY add when PR is ready to merge/full CI is needed
#11531 opened Dec 26, 2024 by ApostaC Loading…
1
[BugFix] Fix parameter names and process_after_weight_loading for W4A16 MoE Group Act Order
#11528 opened Dec 26, 2024 by dsikka Loading…
4
Fixed docker build for ppc64le ci/build
#11518 opened Dec 26, 2024 by npanpaliya Loading…
2
[Platform] Move get_punica_wrapper() function to Platform
#11516 opened Dec 26, 2024 by shen-shanshan • Draft
3
ProTip! Follow long discussions with comments:>50.