Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

webgpu版本有更新计划吗 #380

Open
dotffrt opened this issue Aug 27, 2024 · 1 comment
Open

webgpu版本有更新计划吗 #380

dotffrt opened this issue Aug 27, 2024 · 1 comment

Comments

@dotffrt
Copy link

dotffrt commented Aug 27, 2024

ai00_server 已经更新到0.5.6
尝试直接改名替换文件发现启动模型失败

2024-08-27T15:08:11.595Z INFO [ai00_server] ai00_server version: 0.4.8
2024-08-27T15:08:11.604Z INFO [ai00_server] server started at 127.0.0.1:8000 without tls
2024-08-27T15:08:11.666Z INFO [ai00_server::middleware] loading model "./ai00_server/assets/models/RWKV-x060-World-1B6-v2.1-20240328-ctx4096.st"
2024-08-27T15:08:11.666Z INFO [ai00_server::middleware] ModelInfo {
version: V6,
num_layer: 24,
num_emb: 2048,
num_hidden: 7168,
num_vocab: 65536,
num_head: 32,
time_mix_adapter_size: 32,
time_decay_adapter_size: 64,
}
2024-08-27T15:08:11.667Z INFO [ai00_server::middleware] type: SafeTensors

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants
@dotffrt and others