Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

切换模型失败 #360

Open
lodyke opened this issue Jul 17, 2024 · 8 comments
Open

切换模型失败 #360

lodyke opened this issue Jul 17, 2024 · 8 comments

Comments

@lodyke
Copy link

lodyke commented Jul 17, 2024

{"detail":"failed to load: The MPS backend is supported on MacOS 12.3+.Current OS version can be queried using sw_vers"}
电脑系统版本为:12.7.4
Uploading image.png…

@josStorer
Copy link
Owner

用WebGPU模式

@lodyke
Copy link
Author

lodyke commented Jul 17, 2024

用WebGPU模式

使用 WebGpu 模式 需要转化Safetensors 模式 ,转化提示:bad CPU type in executable: ./backend-rust/web-rwkv-converter
我切换为 WebGpu(python)时 进行转化成功,但是启动时报错信息为: {"detail":"failed to load: failed to request device"}

@mianayo
Copy link

mianayo commented Jul 20, 2024

您好,同样的问题:bad CPU type in executable: ./backend-rust/web-rwkv-converter,macos 14.5 ,AMD Radeon Pro 5700 XT 16 GB,无法使用webgpu转化,请问是不支持吗?

@josStorer
Copy link
Owner

您好,同样的问题:bad CPU type in executable: ./backend-rust/web-rwkv-converter,macos 14.5 ,AMD Radeon Pro 5700 XT 16 GB,无法使用webgpu转化,请问是不支持吗?

用webGPU(Python) 版转换,普通WebGPU转换器是arm架构的

@josStorer
Copy link
Owner

@lodyke failed to request device我也不知道是什么原因,看看 @mianayo 能不能使用成功

@mianayo
Copy link

mianayo commented Jul 20, 2024

@lodyke failed to request device我也不知道是什么原因,看看 @mianayo 能不能使用成功

还是不行,去https://github.com/Ai00-X/ai00_server
这里用网页上的各种办法,有一个可以转换,但是转换出来的.st无法加载,但是可以用webGPU(Python)模式直接加载这个:RWKV-x060-7B-World-v2.1.st。大佬看看是否可以帮忙直接转一个x060-14B的.st的模型,我们直接下载使用。(可能Mac电脑不支持转换?)感谢。

@mianayo
Copy link

mianayo commented Jul 20, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants