Skip to content

Commit

Permalink
make timeout smaller
Browse files Browse the repository at this point in the history
  • Loading branch information
irenedea committed Apr 24, 2024
1 parent 12362a1 commit 15b8b66
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llmfoundry/data/finetuning/tasks.py
Original file line number Diff line number Diff line change
Expand Up @@ -839,7 +839,7 @@ def dataset_mapper(example: Dict):
# A temporary workaround to avoid indefinite hangs observed occasionally due to
# datasets filtering not properly exiting and the dist.barrier() below not timing out.
result_queue = Queue()
filter_timeout = 600
filter_timeout = 60
filter_process = ForkProcess(
target=_filter_dataset,
kwargs={
Expand Down

0 comments on commit 15b8b66

Please sign in to comment.