Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The PILE dataset is full of racist content and thus GPT-J produces racist thinking. #240

Open
azeemh opened this issue Oct 30, 2022 · 2 comments

Comments

@azeemh
Copy link

azeemh commented Oct 30, 2022

Any way to train on a different dataset?

@Joseffb
Copy link

Joseffb commented Jan 10, 2023

I too have a question on how to train the dataset, specifically can we set GPT-J to learn from it's interactions?

@havietisov
Copy link

Model card mentions this :
https://huggingface.co/EleutherAI/gpt-j-6b#out-of-scope-use

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants