Skip to content

Pull requests: NVIDIA/TensorRT-LLM

New pull request New
201 Open 1,108 Closed
201 Open 1,108 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Draft: test: [CI] remove closed bugs
#3890 opened Apr 27, 2025 by xinhe-nv • Draft
[https://nvbugspro.nvidia.com/bug/5246419][fix] Align default setting & remove unnecessary check for chat and completion
#3888 opened Apr 27, 2025 by LinPoly Loading…
Draft: test: [CI] Add failed cases into waives.txt
#3887 opened Apr 27, 2025 by xinhe-nv • Draft
Feat/support multi lora adapters and TP
#3885 opened Apr 27, 2025 by shaharmor98 Loading…
9
fix: remote mpi session abort
#3884 opened Apr 27, 2025 by Superjomn Loading…
8
feat: Llama 4 chunk attention
#3883 opened Apr 27, 2025 by vanshilshah97 • Draft
(draft)refactor: (part1) Add contraints doc for fusedMoe module.
#3882 opened Apr 26, 2025 by HuiGao-NV Loading…
6
feat: integrate modelopt hf export into our quantization script
#3881 opened Apr 26, 2025 by hypdeb Loading…
@hypdeb
6
pick Boyang's change to fix multi streams
#3880 opened Apr 26, 2025 by litaotju Loading…
5
fix: Set num_microbatches=pp_size with overlap scheduler
#3878 opened Apr 26, 2025 by amukkara Loading…
5
fix: [https://nvbugspro.nvidia.com/bug/5242406][fix] Fix fp8 kvcache support
#3877 opened Apr 26, 2025 by hlu1 Loading…
9
feat: Re-enable Llama4 fusion and add AllReduce CUDA Graph Fix
#3876 opened Apr 25, 2025 by zihaok Loading…
Draft: perf: [TRTLLM-4717][perf] Set CUDA graph max batch size and padding in throughput benchmark.
#3875 opened Apr 25, 2025 by FrankD412 Loading…
feat: Add py_state member in LlmRequest class
#3872 opened Apr 25, 2025 by QiJune Loading…
12
fix: [nvbugs/5066257] serialization improvments
#3869 opened Apr 25, 2025 by coldwaterq Loading…
6
Draft: test: [CI] Add failed cases into waives.txt
#3867 opened Apr 25, 2025 by xinhe-nv • Draft
feat: refactoring dataset generation and adding tests others
#3866 opened Apr 25, 2025 by hypdeb Loading…
@hypdeb
33
feat: add relaxed acceptance for DS
#3865 opened Apr 25, 2025 by yweng0828 Loading…
27
tests: skip writing prepare_dataset output to logs
#3864 opened Apr 25, 2025 by ruodil Loading…
@ruodil
fix: Fix FMHA-based MLA in the generation phase and add MLA unit test
#3863 opened Apr 25, 2025 by jinyangyuan-nvidia Loading…
@jinyangyuan-nvidia
6
fix: [https://nvbugspro.nvidia.com/bug/5243482] If FlashMLA is used, the existence of FMHA based MLA kernels should not be checked.
#3862 opened Apr 25, 2025 by bobboli Loading…
1
infra: [TRTLLM-4475][TRTLLM-4565] Add pipeline hierarchy and basic info in the Jenkins job page
#3859 opened Apr 25, 2025 by ZhanruiSunCh • Draft
@ZhanruiSunCh
1
feat: add health_generate route to openai serving Community Engagement Community want to contribute
#3856 opened Apr 25, 2025 by dsingal0 Loading…
1
feat: Add multimodal embedding field in LlmRequest
#3855 opened Apr 25, 2025 by katec846 Loading…
23
feat: enable PP on Llama4
#3854 opened Apr 25, 2025 by v-shobhit Loading…
ProTip! Filter pull requests by the default branch with base:main.