Releases: josStorer/RWKV-Runner
Releases · josStorer/RWKV-Runner
v1.7.0
Changes
Upgrades
- rwkv 0.8.25 (fix v6 fp16i8)
Fixes
- fix /update-config can make the default value of unclearly specified fields invalid by passing in None fields
Chores
- change AVOID_PENALTY to \n only
- chores
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.9
Changes
Upgrades
- web-rwkv-py 0.1.2 (Support V4, V5 and V6) https://github.com/cryscan/web-rwkv-py
- webgpu 0.3.13 https://github.com/cgisky1980/ai00_rwkv_server
Features
- add markdown renderer switch
- allow loading conversation
- allow setting history message number
- expose penalty_decay, top_k
- add AVOID_PENALTY_TOKENS
- add parse_api_log.py, this script can extract
formatted data from api.log
Improvements
- improve macos experience
- improve fine-tune performance
- add better custom tokenizer support and tokenizer-midipiano.json
- improve path processing
- add EOS state cache point
- reduce package size
Fixes
- fix WSL2 WindowsOptionalFeature: Microsoft-Windows-Subsystem-Linux -> VirtualMachinePlatform
- fix finetune errorsMap ($modelInfo)
Chores
- update defaultPresets
- update defaultModelConfigs
- rename manifest tag "Main" -> "Official"
- update manifest.json
- update Related Repositories
- other minor changes
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.8
Changes
- abc music inference support
- basic abc frontend support
- fix finetune errorsMap ($modelInfo)
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.7
Changes
- rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)
- improve memory usage and speed of convert_safetensors.py
- webgpu(python) state cache support
- improve state cache performance (especially for rwkv.cpp)
- chore
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.6
Changes
- improve refreshRemoteModels
- reduce precompiled web_rwkv_py size
- webgpu(Python) max_buffer_size (12B support) and turbo
- improve role-playing effect
- update manifest.json (a lot of new models)
- bump webgpu(ai00_server) mode to v0.3.8
- improve details
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.5
Changes
- update midi_filter_config.json
- Composition Option: Only Auto Play Generated Content
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.4
Changes
- WebGPU (Python) strategy
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.3
Changes
- add WebGPU Python Mode (https://github.com/cryscan/web-rwkv-py)
- bump MIDI-LLM-tokenizer (fix note off)
- fix refreshBuiltInModels
- chore
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.2
Changes
- rwkv.cpp python38 compatibility
- improve rwkv.cpp operation prompts
- add load failed traceback
- fix windows cmd waiting
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
v1.6.1
Changes
- rwkv.cpp(ggml) support
- allow playing mid with external player
- allow overriding Core API URL
- chore
Install
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
- Server-Deploy-Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples