Add to onboarding reproduction logs #2569
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Successfully reproduced results for start-here, experiments-msmarco-passage
Reproduction Environment:
UW Linux server
Java Version: 21.0.3
Maven Version: 3.9.8
Python version: 3.10.12
Setup steps for the linux environment:
PATH
andJAVA_HOME
.I believe it was at the index creation step that the default allocated resources are not enough.
ulimit -n 4096
: increase number of file pointers from 1024 to 4096ulimit -u 8192
: increase number of processes from 4096 to 8192ulimit -t unlimited
: increase CPU time, as suggested in this issue