Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[OpenAI] Add include_usage in streaming, add prefill decode speed to usage #456

Merged
merged 4 commits into from
Jun 5, 2024

Update last chunk handling in examples

7340078
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

[OpenAI] Add include_usage in streaming, add prefill decode speed to usage #456

Update last chunk handling in examples
7340078
Select commit
Loading
Failed to load commit list.

Annotations

1 warning

This job succeeded