New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

增量预训练PT与有监督微调SFT的疑问 #386

Open

VirgilG72 opened this issue Jun 28, 2024 · 1 comment

Labels

question

VirgilG72 commented Jun 28, 2024

大佬，我看你再ipynb的示例中提到“做领域知识注入，SFT比PT更高效，也可以跳过PT阶段”，如果我的领域知识数据集不好构造指令微调数据集，那应该怎么进行SFT呢？大佬有没有什么高见

VirgilG72 added the question label

Owner

shibing624 commented Jun 28, 2024

看下self-instruct.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment