Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Should throw exception for the current text generation call will exceed the model's predefined maximum length (8192) #1016

Open
SidneyLann opened this issue Sep 11, 2024 · 1 comment
Labels
currently fixing Am fixing now! URGENT BUG Urgent bug

Comments

@SidneyLann
Copy link

This is a friendly reminder - the current text generation call will exceed the model's predefined maximum length (8192). Depending on the model, you may observe exceptions, performance degradation, or nothing at all.

After this log, the program stop with no exception throw, why not throw an exception for catching to continue running the program?

@danielhanchen
Copy link
Contributor

Apologies on the delay - you're correct an exception should be thrown - will do just that!

@danielhanchen danielhanchen added currently fixing Am fixing now! URGENT BUG Urgent bug labels Sep 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
currently fixing Am fixing now! URGENT BUG Urgent bug
Projects
None yet
Development

No branches or pull requests

2 participants