-
Notifications
You must be signed in to change notification settings - Fork 473
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[DOC] Add support for Bedrock Converse API #8195
Comments
We are introducing a new RAG search processor parameter called "llm_messages". This is intended to match one-to-one the "messages" parameter of the Bedrock Converse API (https://docs.aws.amazon.com/bedrock/latest/APIReference/API_runtime_Converse.html) and therefore, an array of messages (llm_messages) passed to the RAG search processor will be converted to an array of Message objects and passed to Bedrock. llm_messages = [ MessageBlock ] ( content_type = "text" | "image" | "document" Example 1: text Example 2: image Example 3: document |
llm_model prefix must be "bedrock-converse/", e.g. |
Example 4: text + image + document |
@austintlee: Can you submit a PR with these updates? |
I'll do that today. We already have a page that explains all the parameters, but I don't know if this needs a dedicated/separate page. |
@Naarcha-AWS, please remove the 2.17 tag since this feature is not included in 2.17 anymore. |
What do you want to do?
Tell us about your request. Provide a summary of the request.
ml-commons is adding support for Bedrock Converse API that allows RAG users to gain access to the latest LLMs from Anthropic, i.e. Claude 3.5 sonnet. In addition, this will also work with OpenAI GPT 4o for including images in chats.
*Version: List the OpenSearch version to which this issue applies, e.g. 2.14, 2.12--2.14, or all.
What other resources are available? Provide links to related issues, POCs, steps for testing, etc.
The text was updated successfully, but these errors were encountered: