Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to add a new algoritm to refresh the benchmark #55

Open
DhavalRepo18 opened this issue Dec 4, 2023 · 2 comments
Open

How to add a new algoritm to refresh the benchmark #55

DhavalRepo18 opened this issue Dec 4, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@DhavalRepo18
Copy link

We need a guide to add a new framework for enhancing the benchmark.

@Innixma
Copy link
Collaborator

Innixma commented Dec 19, 2023

Yes, definitely! Thank you for your interest. I am in the process of writing code that will allow to merge benchmark contexts together to make it easy to add a new framework's results without having to manually reconstruct the original Context from the paper. Expect this to be available and with a tutorial by end of January 2024.

@Innixma Innixma added the enhancement New feature or request label Dec 19, 2023
@Innixma Innixma self-assigned this Dec 19, 2023
@Innixma
Copy link
Collaborator

Innixma commented Jun 13, 2024

Update on this, unfortunately the merge logic was more complicated than I anticipated at the time and other tasks ended up taking priority.

I do still plan to improve the new framework addition logic when I find bandwidth. The tricky part is that we did a great deal of optimization and that optimization leads to a more complex object representation that isn't trivial to merge.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants