Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a gRPC batch leaf requests endpoint #3757

Closed
fmassot opened this issue Aug 17, 2023 · 2 comments
Closed

Add a gRPC batch leaf requests endpoint #3757

fmassot opened this issue Aug 17, 2023 · 2 comments
Labels
enhancement New feature or request project:airmail

Comments

@fmassot
Copy link
Contributor

fmassot commented Aug 17, 2023

In #3734, we added the multi indexes search.

The root search node now sends leaf requests for each index to leaf nodes. Consequently, the root node will need to merge more leaf responses. This can put a lot of pressure on the root node.

To avoid that, we should introduce a gRPC batch leaf request endpoint so the root node can send multiple leaf requests to a given leaf node. The leaf node will then execute the search on those leaf requests and pre-merge their results before sending the result back to the root.

@fmassot fmassot added the enhancement New feature or request label Aug 17, 2023
@fmassot
Copy link
Contributor Author

fmassot commented Aug 17, 2023

Using the pattern as suggested by @guilload here, sounds a good idea to solve this issue too.

@guilload
Copy link
Member

Closed via #4962.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request project:airmail
Projects
None yet
Development

No branches or pull requests

2 participants