New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于GLM3微调细节 #281

Open

DeMoth-1 opened this issue Dec 5, 2023 · 3 comments

Labels

question

DeMoth-1 commented Dec 5, 2023

请问在使用SFT微调ChatGLM3时，您有根据数据集角色处理添加特殊Tokens吗？我翻了一下代码没有找到相关信息，请教一下。

DeMoth-1 added the question label

Owner

shibing624 commented Dec 5, 2023

没

Author

DeMoth-1 commented Dec 5, 2023

哦哦好的

Author

DeMoth-1 commented Dec 5, 2023

https://github.com/minghaochen/chatglm3-base-tuning
项目实现了对GLM3特殊tokens的处理，您可以考虑整合一下

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment