Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Endpoint to see if a model supports streaming #64

Open
alexanderatallah opened this issue May 27, 2023 · 0 comments
Open

Endpoint to see if a model supports streaming #64

alexanderatallah opened this issue May 27, 2023 · 0 comments
Labels
question Further information is requested

Comments

@alexanderatallah
Copy link
Owner

alexanderatallah commented May 27, 2023

Currently, there isn't an endpoint for checking on streaming support, but that's a good idea. right now, if models can't stream, onStreamResult will just never fire, but the overall promise will resolve with the full completion at the end, so at that point you'll know that streaming isn't supported

@alexanderatallah alexanderatallah converted this from a draft issue May 27, 2023
@alexanderatallah alexanderatallah added help wanted Extra attention is needed good first issue Good for newcomers question Further information is requested and removed help wanted Extra attention is needed good first issue Good for newcomers labels May 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
No open projects
Status: No status
Development

No branches or pull requests

1 participant