v1.8.1

github-actions released this 12 May 15:45

· 72 commits to master since this release

bfbf43f

Changes

Features

add support for dynamic state-tuned models

Upgrades

bump webgpu mode ai00_server v0.4.8

Improvements

add tps console output
add torch cnMirror
disable pre_ffn and head_qk
improve frontend details

Chores

update manifest.json and defaultModelConfigs

Install

Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples

Assets 6