Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add multi knowledgebase #981

Merged
merged 1 commit into from
May 8, 2024
Merged

Conversation

Abirdcfly
Copy link
Collaborator

@Abirdcfly Abirdcfly commented Apr 3, 2024

What type of PR is this?

/kind cleanup
/kind feature

What this PR does / why we need it

has tested in gpu 167 env, old application also works.
can update to new app node by update app config in web ui.

CleanShot 2024-04-16 at 14 48 46
The above gif shows a complex application that uses 2 knowledgebases, one knowledgebase to provide knowledge of attendance and one knowledgebase to provide knowledge of arbiter and the application uses multiquery and rerank.

Which issue(s) this PR fixes

Fixes #

Special notes for your reviewer

  1. add mergerRetriever to merge multi-knowledgebase like langchain python does.
  2. add conversation-knowledgebase-placeholder to appruntime and app nodes, this placeholder clearly indicates that there may be a conversation knowledgebase here.
  3. add knowledgebases to updateApplicationConfig gql input and resp for support multiquery knowledgebases, also compatible with the old single knowledgebase model. ( @Carrotzpc front end also need update to support multiquery knowledgebases.)
  4. add tests.

无标题-2024-02-28-0940

@Abirdcfly Abirdcfly force-pushed the mulkb branch 19 times, most recently from 3e9a662 to de43bdc Compare April 10, 2024 08:27
@Abirdcfly Abirdcfly force-pushed the mulkb branch 11 times, most recently from 30ee741 to 541a7ed Compare April 12, 2024 04:09
@Abirdcfly Abirdcfly force-pushed the mulkb branch 19 times, most recently from 5af947f to 6b774db Compare April 19, 2024 06:37
@Abirdcfly Abirdcfly force-pushed the mulkb branch 5 times, most recently from f582c67 to 14037e6 Compare April 19, 2024 16:02
@Abirdcfly Abirdcfly marked this pull request as ready for review April 21, 2024 03:27
@nkwangleiGIT nkwangleiGIT merged commit d9a4181 into kubeagi:main May 8, 2024
10 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants