Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

linux 模型运行失败 #386

Open
0xHertz opened this issue Sep 5, 2024 · 7 comments
Open

linux 模型运行失败 #386

0xHertz opened this issue Sep 5, 2024 · 7 comments

Comments

@0xHertz
Copy link

0xHertz commented Sep 5, 2024

在ubuntu24.04系统中，下载runner客户端并安装所需python依赖后
命令行运行python main.py可以正常启动
Screenshot from 2024-09-05 16-08-23
但是在runner客户端点击运行，显示启动中后直接结束，并没有运行起来
Screenshot from 2024-09-05 16-08-49
Screenshot from 2024-09-05 16-08-54
我的主机没有GPU，不知道是否是必须的
@0xHertz
Copy link
Author

0xHertz commented Sep 5, 2024

无报错信息

@josStorer
Copy link
Owner

试试自己调用 /switch-model 载入模型, 可以看到详细的控制台错误输出, 如果进程直接崩溃, 可能是载入的模型太大, 内存不足

@0xHertz
Copy link
Author

0xHertz commented Sep 6, 2024

Screenshot from 2024-09-06 17-13-54

@0xHertz
Copy link
Author

0xHertz commented Sep 6, 2024

调用 /switch-model 后具体的报错截图如上，是否有解决方案，谢谢

@0xHertz
Copy link
Author

0xHertz commented Sep 6, 2024

更多信息
Screenshot from 2024-09-06 17-18-04

@josStorer
Copy link
Owner

看着像是内存不足， 进程直接被杀了

@0xHertz
Copy link
Author

0xHertz commented Sep 9, 2024

换了更小的模型，还是同样的问题
Screenshot from 2024-09-09 14-43-18

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@josStorer @0xHertz