Skip to content

Pull requests: huggingface/text-generation-inference

New pull request New
13 Open 1,418 Closed
13 Open 1,418 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Trying to avoid the random timeout.
#2929 opened Jan 20, 2025 by Narsil Loading…
5 tasks
Add fp8 support moe models
#2928 opened Jan 20, 2025 by mht-sharma Loading…
5 tasks
Flash Transformers modeling backend support
#2913 opened Jan 15, 2025 by Cyrilvallez Loading…
9
Give TensorRT-LLMa proper CI/CD 😍
#2886 opened Jan 7, 2025 by mfuntowicz Loading…
6
Update Dockerfile to use devel image for compatibility
#2848 opened Dec 16, 2024 by YaserJaradeh Loading…
2 of 5 tasks
8
[TRTLLM] Expose finish reason
#2841 opened Dec 13, 2024 by mfuntowicz Loading…
1
Exposes TensorRT-LLM finish reason to the server
#2818 opened Dec 10, 2024 by mfuntowicz • Draft
Enable qwen2vl video
#2756 opened Nov 18, 2024 by drbh Loading…
9 tasks done
24
Add llama.cpp backend
#2723 opened Nov 4, 2024 by mfuntowicz Loading…
13
Get opentelemetry trace id from request headers instead of creating a new trace
#2648 opened Oct 15, 2024 by kozistr Loading…
3 of 5 tasks
1
3
[WIP] Add gfx1100 support to AMD pytorch build
#2642 opened Oct 13, 2024 by cazlo • Draft
1 of 5 tasks
1
2
[DOCS] Add Google Cloud TGI integration via dedicated DLCs
#2612 opened Oct 5, 2024 by alvarobartt • Draft
1 of 5 tasks
8
Add model_load_time metric
#2311 opened Jul 26, 2024 by Edwinhr716 Loading…
2 of 5 tasks
2
ProTip! What’s not been updated in a month: updated:<2024-12-20.