Skip to content

Commit

Permalink
remove num_fewshot arg check for multiturn
Browse files Browse the repository at this point in the history
  • Loading branch information
artemorloff committed Aug 29, 2024
1 parent 273b69e commit d7acdc6
Showing 1 changed file with 0 additions and 9 deletions.
9 changes: 0 additions & 9 deletions lm_eval/__main__.py
Original file line number Diff line number Diff line change
Expand Up @@ -310,15 +310,6 @@ def cli_evaluate(args: Union[argparse.Namespace, None] = None) -> None:
)
)

if (
args.num_fewshot is None or args.num_fewshot == 0
) and args.fewshot_as_multiturn:
# if no fewshots, multiturn has no sense, disable it
args.fewshot_as_multiturn = False
eval_logger.warning(
"If fewshot_as_multiturn is set, num_fewshot must be greater than 0. Disabling `fewshot_as_multiturn`."
)

if args.include_path is not None:
eval_logger.info(f"Including path: {args.include_path}")
task_manager = TaskManager(args.verbosity, include_path=args.include_path)
Expand Down

0 comments on commit d7acdc6

Please sign in to comment.