Skip to content

Commit

Permalink
release v1.7.9
Browse files Browse the repository at this point in the history
  • Loading branch information
josStorer committed Apr 30, 2024
1 parent ae1d01b commit d075d63
Showing 1 changed file with 36 additions and 1 deletion.
37 changes: 36 additions & 1 deletion CURRENT_CHANGE.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,41 @@
## Changes

- bump webgpu mode (https://github.com/Ai00-X/ai00_server) (#321)
- bump webgpu mode [ai00_server v0.4.2](https://github.com/Ai00-X/ai00_server) (huge performance improvement)
- upgrade to rwkv 0.8.26 (state-tuned model support)
- update defaultConfigs and manifest.json
- chores

## Breaking Changes

- change the default value of `presystem` to false

For the convenience of using the future state-tuned models, the default value of `presystem` has been set to false. This
means that the RWKV-Runner service will no longer automatically insert recommended RWKV pre-prompts for you:

```
User: hi
Assistant: Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it.
```

If you are using the API service and conducting a rigorous RWKV conversation, please manually send the above messages to
the `/chat/completions` API's `messages` array, or manually send `presystem: true` to have the server automatically
insert pre-prompts.

If you are using the RWKV-Runner client for chatting, you can enable `Insert default system prompt at the beginning` in
the preset editor.

Of course, in reality, even if you do not perform the above, there is usually no significant negative impact.

If you are using the new RWKV state-tuned models, you do not need to perform the above.

The new RWKV state-tuned models can be downloaded here, they are very interesting:

- https://huggingface.co/BlinkDL/rwkv-6-state-instruct-aligned
- https://huggingface.co/BlinkDL/temp-latest-training-models

If you are interested in state-tuning, please refer
to: https://github.com/BlinkDL/RWKV-LM#state-tuning-tuning-the-initial-state-zero-inference-overhead

## Install

Expand Down

0 comments on commit d075d63

Please sign in to comment.