Update TGI specs (+ define TextToSpeech independently) #915
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR pulls latest changes from TGI specs. In particular:
ChatCompletionInputMessageContent
=> now supports single message (as before), array of messages and sending image as input (in case of VLMs)stream_options
Note: TGI specs have a
guideline
input parameter for chat completion. I removed it from the official specs as it's a very specific parameter and subject to deletion in the near future (it was there to fix a chat template issue forShieldGemma
models). More context here (internal).Note: I also took the opportunity to define
TextToSpeech
specs independently fromTextToAudio
(otherwise the semi-automatic scripts are not working properly). Nothing has changed in the specs.I'll open a related PR on
huggingface_hub
side to reflect this change.