diff --git a/.github/workflows/pr-stage-check.yml b/.github/workflows/pr-stage-check.yml index 8d2c62bd9..15669a3fb 100644 --- a/.github/workflows/pr-stage-check.yml +++ b/.github/workflows/pr-stage-check.yml @@ -44,8 +44,8 @@ jobs: run: python -m pip install -e . - name: Prepare dataset run: | - wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip - unzip OpenCompassData-core-20231110.zip + wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip + unzip OpenCompassData-core-20240207.zip - name: Dry run test run: | python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run @@ -85,8 +85,8 @@ jobs: run: python -m pip install -e . - name: Prepare dataset run: | - wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip - unzip OpenCompassData-core-20231110.zip + wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip + unzip OpenCompassData-core-20240207.zip - name: Dry run test run: | python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run @@ -114,8 +114,8 @@ jobs: run: pip install -e . - name: Prepare dataset run: | - Invoke-WebRequest -Uri https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip -OutFile OpenCompassData-core-20231110.zip - unzip OpenCompassData-core-20231110.zip + Invoke-WebRequest -Uri https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip -OutFile OpenCompassData-core-20240207.zip + unzip OpenCompassData-core-20240207.zip - name: Dry run test run: | python run.py --models hf_opt_125m --datasets siqa_gen winograd_ppl --dry-run diff --git a/README.md b/README.md index b66ee7aa7..e8f35340f 100644 --- a/README.md +++ b/README.md @@ -114,8 +114,8 @@ pip install -e . ```bash # Download dataset to data/ folder -wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip -unzip OpenCompassData-core-20231110.zip +wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip +unzip OpenCompassData-core-20240207.zip ``` Some third-party features, like Humaneval and Llama, may require additional steps to work properly, for detailed steps please refer to the [Installation Guide](https://opencompass.readthedocs.io/en/latest/get_started/installation.html). diff --git a/README_zh-CN.md b/README_zh-CN.md index b6b2984cd..21e2100bd 100644 --- a/README_zh-CN.md +++ b/README_zh-CN.md @@ -116,8 +116,8 @@ pip install -e . ```bash # 下载数据集到 data/ 处 -wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip -unzip OpenCompassData-core-20231110.zip +wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip +unzip OpenCompassData-core-20240207.zip ``` 有部分第三方功能,如 Humaneval 以及 Llama,可能需要额外步骤才能正常运行,详细步骤请参考[安装指南](https://opencompass.readthedocs.io/zh_CN/latest/get_started/installation.html)。 diff --git a/docs/en/get_started/installation.md b/docs/en/get_started/installation.md index a27b42870..00507fb42 100644 --- a/docs/en/get_started/installation.md +++ b/docs/en/get_started/installation.md @@ -83,20 +83,20 @@ Run the following commands to download and place the datasets in the `${OpenComp ```bash # Run in the OpenCompass directory -wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip -unzip OpenCompassData-core-20231110.zip +wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip +unzip OpenCompassData-core-20240207.zip ``` If you need to use the more comprehensive dataset (~500M) provided by OpenCompass, You can download and `unzip` it using the following command: ```bash -wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-complete-20231110.zip -unzip OpenCompassData-complete-20231110.zip +wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-complete-20240207.zip +unzip OpenCompassData-complete-20240207.zip cd ./data find . -name "*.zip" -exec unzip {} \; ``` -The list of datasets included in both `.zip` can be found [here](https://github.com/open-compass/opencompass/releases/tag/0.1.8.rc1) +The list of datasets included in both `.zip` can be found [here](https://github.com/open-compass/opencompass/releases/tag/0.2.2.rc1) OpenCompass has supported most of the datasets commonly used for performance comparison, please refer to `configs/dataset` for the specific list of supported datasets. diff --git a/docs/zh_cn/get_started/installation.md b/docs/zh_cn/get_started/installation.md index c7fe38bda..86061e70c 100644 --- a/docs/zh_cn/get_started/installation.md +++ b/docs/zh_cn/get_started/installation.md @@ -84,20 +84,20 @@ OpenCompass 支持的数据集主要包括两个部分: 在 OpenCompass 项目根目录下运行下面命令,将数据集准备至 `${OpenCompass}/data` 目录下: ```bash -wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-core-20231110.zip -unzip OpenCompassData-core-20231110.zip +wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip +unzip OpenCompassData-core-20240207.zip ``` 如果需要使用 OpenCompass 提供的更加完整的数据集 (~500M),可以使用下述命令进行下载和解压: ```bash -wget https://github.com/open-compass/opencompass/releases/download/0.1.8.rc1/OpenCompassData-complete-20231110.zip -unzip OpenCompassData-complete-20231110.zip +wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-complete-20240207.zip +unzip OpenCompassData-complete-20240207.zip cd ./data find . -name "*.zip" -exec unzip {} \; ``` -两个 `.zip` 中所含数据集列表如[此处](https://github.com/open-compass/opencompass/releases/tag/0.1.8.rc1)所示。 +两个 `.zip` 中所含数据集列表如[此处](https://github.com/open-compass/opencompass/releases/tag/0.2.2.rc1)所示。 OpenCompass 已经支持了大多数常用于性能比较的数据集,具体支持的数据集列表请直接在 `configs/datasets` 下进行查找。