From 81b67e8d9ea38fd8c0efc4fadc7e6e02c12ec00e Mon Sep 17 00:00:00 2001 From: Songyang Zhang Date: Fri, 24 Nov 2023 11:24:00 +0800 Subject: [PATCH] [Doc] Update README (#629) * update readme * fix typo * Update README.md --------- Co-authored-by: liushz --- README.md | 12 ++++++++++++ README_zh-CN.md | 12 ++++++++++++ 2 files changed, 24 insertions(+) diff --git a/README.md b/README.md index 856671b24..e847991ba 100644 --- a/README.md +++ b/README.md @@ -21,6 +21,18 @@ English | [简体中文](README_zh-CN.md) 👋 join us on Discord and WeChat

+## 📣 OpenCompass 2023 LLM Annual Leaderboard + +We are honored to have witnessed the tremendous progress of artificial general intelligence together with the community in the past year, and we are also very pleased that **OpenCompass** can help numerous developers and users. + +We announce the launch of the **OpenCompass 2023 LLM Annual Leaderboard** plan. We expect to release the annual leaderboard of the LLMs in January 2024, systematically evaluating the performance of LLMs in various capabilities such as language, knowledge, reasoning, creation, long-text, and agents. + +At that time, we will release rankings for both open-source models and commercial API models, aiming to provide a comprehensive, objective, and neutral reference for the industry and research community. + +We sincerely invite various large models to join the OpenCompass to showcase their performance advantages in different fields. At the same time, we also welcome researchers and developers to provide valuable suggestions and contributions to jointly promote the development of the LLMs. If you have any questions or needs, please feel free to [contact us](mailto:opencompass@pjlab.org.cn). In addition, relevant evaluation contents, performance statistics, and evaluation methods will be open-source along with the leaderboard release. + +Let's look forward to the release of the OpenCompass 2023 LLM Annual Leaderboard! + ## 🧭 Welcome to **OpenCompass**! diff --git a/README_zh-CN.md b/README_zh-CN.md index ade418a35..c5877fd75 100644 --- a/README_zh-CN.md +++ b/README_zh-CN.md @@ -21,6 +21,18 @@ 👋 加入我们的 Discord 和 微信社区

+## 📣 2023 年度榜单计划 + +我们有幸与社区共同见证了通用人工智能在过去一年里的巨大进展，也非常高兴OpenCompass能够帮助广大大模型开发者和使用者。 + +我们宣布将启动**OpenCompass 2023年度大模型榜单**发布计划。我们预计将于2024年1月发布大模型年度榜单，系统性评估大模型在语言、知识、推理、创作、长文本和智能体等多个能力维度的表现。 + +届时，我们将发布开源模型和商业API模型能力榜单，以期为业界提供一份**全面、客观、中立**的参考。 + +我们诚挚邀请各类大模型接入OpenCompass评测体系，以展示其在各个领域的性能优势。同时，也欢迎广大研究者、开发者向我们提供宝贵的意见和建议，共同推动大模型领域的发展。如有任何问题或需求，请随时[联系我们](mailto:opencompass@pjlab.org.cn)。此外，相关评测内容，性能数据，评测方法也将随榜单发布一并开源。 + +

让我们共同期待OpenCompass 2023年度大模型榜单的发布，期待各大模型在榜单上的精彩表现！

+ ## 🧭 欢迎 来到**OpenCompass**！