File tree 1 file changed +1
-1
lines changed
1 file changed +1
-1
lines changed Original file line number Diff line number Diff line change @@ -21,7 +21,7 @@ So it's combining the best of RNN and transformer - great performance, fast infe
21
21
| Version | v4 - Raven | v4 - Dove | v5 - Eagle | v6 - Finch |
22
22
| ---| ---| ---| ---| ---|
23
23
| Paper | 🎓[ Paper Accepted @ EMNLP 2023] ( https://arxiv.org/abs/2305.13048 ) | (no architecture change) | [ 🔧 stable] ( https://arxiv.org/abs/2404.05892 ) | [ 🔧 stable] ( https://arxiv.org/abs/2404.05892 ) |
24
- | Overall Status | 🌚 EOL - Recommended to use v6 instead | 🌚 EOL - Recommended to use v6 instead | ✅ General Availability | 🧪 Early Training |
24
+ | Overall Status | 🌚 EOL - Recommended to use v6 instead | 🌚 EOL - Recommended to use v6 instead | ✅ General Availability | ✅ General Availability |
25
25
| 0.4B model | [ Fully Trained : rwkv-pile-430m] ( https://huggingface.co/RWKV/rwkv-4-430m-pile ) | [ Fully Trained] ( https://huggingface.co/RWKV/rwkv-4-world-430m ) | ✅ [ Fully Trained] ( https://huggingface.co/BlinkDL/rwkv-5-world/blob/main/RWKV-5-World-0.4B-v2-20231113-ctx4096.pth ) | ... |
26
26
| 1.5B model | [ Fully Trained : rwkv-raven-1b5] ( https://huggingface.co/RWKV/rwkv-raven-1b5 ) | [ Fully Trained] ( https://huggingface.co/RWKV/rwkv-4-world-1b5 ) | ✅ [ Fully Trained] ( https://huggingface.co/BlinkDL/rwkv-5-world/blob/main/RWKV-5-World-1B5-v2-20231025-ctx4096.pth ) | ✅ [ Fully Trained] ( https://huggingface.co/RWKV/v6-Finch-1B6-HF ) |
27
27
| 3B model | [ Fully Trained : rwkv-raven-3b] ( https://huggingface.co/RWKV/rwkv-raven-3b ) | [ Fully Trained] ( https://huggingface.co/RWKV/rwkv-4-world-3b ) | ✅ [ Fully Trained] ( https://huggingface.co/BlinkDL/rwkv-5-world/blob/main/RWKV-5-World-3B-v2-20231118-ctx16k.pth ) | ✅ [ Fully Trained] ( https://huggingface.co/RWKV/v6-Finch-3B-HF ) |
You can’t perform that action at this time.
0 commit comments