Some simple or fake implementations of LLM infra function
todo:
training:
parallel_implementation
inference (vllm features): clean_vllm
- chunked
- paged attention
cuda algorithm
- flash attention
-
Notifications
You must be signed in to change notification settings - Fork 0
Some simple or fake implementations of LLM infra function
License
SendoRay/simple_LLM
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Some simple or fake implementations of LLM infra function
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published