Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Java: Add rate limit metadata values to OpenAIStreamingChatMessageContent and OpenAIChatMessageContent #203

Open
d3r3kk opened this issue Sep 3, 2024 · 0 comments
Open

Java: Add rate limit metadata values to OpenAIStreamingChatMessageContent and OpenAIChatMessageContent #203

d3r3kk opened this issue Sep 3, 2024 · 0 comments
Labels
java Pull requests that update Java code

Comments

@d3r3kk
Copy link
Contributor

d3r3kk commented Sep 3, 2024

Raw Azure OpenAi chat completion response contains additional headers, which contain information about rate limits:
x-rate-limit-remaining-requests and x-ratelimit-remaining-tokens. Would it be possible to add these values to the Metadata dictionary in both OpenAIStreamingChatMessageContent and OpenAIChatMessageContent class? I find rate limit information useful, but in current .Net implementation there is no way to access it.

See microsoft/semantic-kernel#8421 for the .NET version of this issue.
@d3r3kk d3r3kk added the java Pull requests that update Java code label Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
java Pull requests that update Java code
Projects
Semantic Kernel
Status: No status
Milestone
No milestone
Development

No branches or pull requests
1 participant
@d3r3kk