Skip to content

Commit

Permalink
add todo
Browse files Browse the repository at this point in the history
  • Loading branch information
baberabb committed Sep 1, 2024
1 parent ec951cb commit dac8b53
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions lm_eval/api/task.py
Original file line number Diff line number Diff line change
Expand Up @@ -1113,6 +1113,7 @@ def fewshot_context(
)
# for loglikelihood create a list of questions with appended choices
elif isinstance(example, list):
# TODO<baber>: when is example a list?
labeled_examples_list = []
# copy chat history for each example and append the answer
for ex in example:
Expand Down

0 comments on commit dac8b53

Please sign in to comment.