Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[OpenAI] Add include_usage in streaming, add prefill decode speed to usage #456

Merged
merged 4 commits into from
Jun 5, 2024
Merged

[OpenAI] Add include_usage in streaming, add prefill decode speed to usage #456

merged 4 commits into from
Jun 5, 2024

Commits on Jun 4, 2024

  1. [OpenAI] Add usage to streaming, add prefill and decode speed to usage

    @CharlieFRuan
    CharlieFRuan committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    4d340b1 View commit details
    Browse the repository at this point in the history

  2. Add include_usage and yield usage in another last chunk

    @CharlieFRuan
    CharlieFRuan committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    e33f0e7 View commit details
    Browse the repository at this point in the history

  3. Update readme

    @CharlieFRuan
    CharlieFRuan committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    3f9e529 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. Update last chunk handling in examples

    @CharlieFRuan
    CharlieFRuan committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    7340078 View commit details
    Browse the repository at this point in the history