added doc for test2

castorini · Sep 23, 2024 · ec57e96 · ec57e96
1 parent 0ea8369
commit ec57e96
Show file tree

Hide file tree

Showing 2 changed files with 9 additions and 7 deletions.
diff --git a/docs/fuse-regressions/test-setup.md b/docs/fuse-regressions/test-setup.md
@@ -7,7 +7,7 @@ You will need the following:
 - A working installation of `wget`.
 - Enough disk space to store the downloaded files.
 
-## Automatic Download Using Script
+## Automatic Download Using Script for test0/1
 To automatically download the required files, you can use the following shell script. The script will download and extract the files in the `runs/runs.beir` folder with the correct filenames.
 
 ```bash
@@ -21,10 +21,16 @@ wget --no-check-certificate 'https://drive.google.com/uc?export=download&id=1XVl
 wget --no-check-certificate 'https://drive.google.com/uc?export=download&id=1Z4rWlNgmXebMf1ardfiDg_4KIZImjqxt' -O runs/runs.beir/run.inverted.beir-v1.0.0-robust04.splade-pp-ed.test.splade-pp-ed-cached
 wget --no-check-certificate 'https://drive.google.com/uc?export=download&id=1fExxJHkPPNCdtptKqWTbcsH0Ql0PnPqS' -O runs/runs.beir/run.inverted.beir-v1.0.0-robust04.flat.test.bm25
 ```
+## Perform two regression runs for test2
+One could generate the runs necessary for test 3 following 
+- https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-beir-v1.0.0-robust04.bge-base-en-v1.5.flat-int8.cached.md
+- https://github.com/castorini/anserini/blob/master/docs/regressions/regressions-beir-v1.0.0-robust04.bge-base-en-v1.5.flat.cached.md
 
 ## Run fuse-regression script with two yaml tests
 ```bash
 python src/main/python/run_fusion_regression.py --regression test_0
 
 python src/main/python/run_fusion_regression.py --regression test_1
+
+python src/main/python/run_fusion_regression.py --regression test_2
 ```
diff --git a/...ain/resources/fuse_regression/test_3.yaml → ...ain/resources/fuse_regression/test_2.yaml b/...ain/resources/fuse_regression/test_3.yaml → ...ain/resources/fuse_regression/test_2.yaml
@@ -25,12 +25,8 @@ metrics:
     metric_precision: 4
     can_combine: false
 
-topic_reader: JsonStringVector
-topics:
-  - name: "BEIR (v1.0.0): Robust04"
-    id: test
-    path: topics.beir-v1.0.0-robust04.test.bge-base-en-v1.5.jsonl.gz
-    qrel: qrels.beir-v1.0.0-robust04.test.txt
+
+
 
 # Fusion Regression Test Configuration
 runs: