Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 19.3k 3.2k

2. sgl-project/SpecForge sgl-project/SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 439 100

3. PaddlePaddle/Paddle PaddlePaddle/Paddle Public

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++ 23.3k 5.9k

4. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 7.2k 611

5. open-mmlab/mmdeploy open-mmlab/mmdeploy Public

   OpenMMLab Model Deployment Framework

   Python 3.1k 678