Pinned Loading

1. mlc-llm mlc-llm Public

   Universal LLM Deployment Engine with ML Compilation

   Python 21.7k 1.9k

2. web-llm web-llm Public

   High-performance In-browser LLM Inference Engine

   TypeScript 16.9k 1.1k

3. mlc-zh mlc-zh Public

   Python 619 67

4. mlc-en mlc-en Public

   Python 444 55

5. web-llm-chat web-llm-chat Public

   Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

   TypeScript 890 169

6. xgrammar xgrammar Public

   Fast, Flexible and Portable Structured Generation

   C++ 1.4k 103