Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 55.4k 9.4k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 16.9k 2.6k

3. GeeeekExplorer/nano-vllm GeeeekExplorer/nano-vllm Public

   Nano vLLM

   Python 5.8k 712

4. LMCache/LMCache LMCache/LMCache Public

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python 4.3k 488

5. chunhuizhang/pytorch_distribute_tutorials chunhuizhang/pytorch_distribute_tutorials Public

   pytorch distribute tutorials

   Jupyter Notebook 146 31

6. llm-scratch-pytorch llm-scratch-pytorch Public

   lm-scratch-pytorch - The code is designed to be beginner-friendly, with a focus on understanding the fundamentals of PyTorch and implementing LLMs from scratch,step by step.

   Jupyter Notebook 101 4