Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 55.7k 9.5k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 1.8k 207

  3. recipes recipes Public

    Common recipes to run vLLM

    104 24

Repositories

Showing 10 of 21 repositories
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 55,698 Apache-2.0 9,495 1,799 (17 issues need help) 986 Updated Aug 19, 2025
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 8 20 1 21 Updated Aug 19, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,044 Apache-2.0 428 213 (21 issues need help) 19 Updated Aug 19, 2025
  • recipes Public

    Common recipes to run vLLM

    vllm-project/recipes’s past year of commit activity
    104 Apache-2.0 24 2 5 Updated Aug 19, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 30 Apache-2.0 21 8 10 Updated Aug 19, 2025
  • vllm-project.github.io Public
    vllm-project/vllm-project.github.io’s past year of commit activity
    HTML 14 20 0 0 Updated Aug 19, 2025
  • vllm-xpu-kernels Public

    The vLLM XPU kernels for Intel GPU

    vllm-project/vllm-xpu-kernels’s past year of commit activity
    Python 5 Apache-2.0 8 0 5 Updated Aug 19, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,016 Apache-2.0 349 322 (5 issues need help) 142 Updated Aug 19, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 495 Apache-2.0 68 62 (5 issues need help) 18 Updated Aug 19, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 1,804 Apache-2.0 207 45 (7 issues need help) 35 Updated Aug 18, 2025
View all repositories

Sponsors

  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
  • @mhupfauer
  • @dvlpjrs
  • @vincentkoc
  • @robertgshaw2-redhat
  • Private Sponsor