Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Free space allocated for LM in the memory after evaluation finishes #2277

Closed
wants to merge 2 commits into from
Closed

Free space allocated for LM in the memory after evaluation finishes #2277

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
fb23b3f
Deletes lm object after simple_evaluate function finishes
ahmedamrelhefnawy Sep 3, 2024
630bba4
Stricted 'lm' object to be deleted only if it wasn't an already-initi…
ahmedamrelhefnawy Sep 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions lm_eval/evaluator.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -357,8 +357,16 @@ def _adjust_config(task_dict):
results["date"] = start_date
add_env_info(results) # additional environment info to results
add_tokenizer_info(results, lm) # additional info about tokenizer

if not isinstance(model, lm_eval.api.model.LM):
del lm

return results
else:

if not isinstance(model, lm_eval.api.model.LM):
del lm

return None


Expand Down
Loading