Skip to content

Commit

Permalink
check for errors during preprocessing, not after
Browse files Browse the repository at this point in the history
  • Loading branch information
FabianIsensee committed Apr 18, 2024
1 parent 821ded9 commit 1915165
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -252,6 +252,7 @@ def run(self, dataset_name_or_id: Union[int, str], configuration_name: str, plan
'reducing the number of workers might help')
done = [i for i in remaining if r[i].ready()]
for _ in done:
r[_].get() # allows triggering errors
pbar.update()
remaining = [i for i in remaining if i not in done]
sleep(0.1)
Expand Down

0 comments on commit 1915165

Please sign in to comment.