diff --git a/README.en.md b/README.en.md
index 34639285441f3..504ecdac1e11c 100644
--- a/README.en.md
+++ b/README.en.md
@@ -13,8 +13,8 @@ ERNIE 2.0 builds a strong basic for nearly every NLP tasks: Text Classification,
 # News
 
 - May.20.2021:
-    - [`ERNIE-Doc`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-doc), [`ERNIE-Gram`](./ernie_gram/), [`ERNIE-ViL`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil) models are **avaliable** now!
-    - `ERNIE-UNIMO` will be released soon.
+    - [`ERNIE-Doc`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-doc), [`ERNIE-Gram`](./ernie-gram/), [`ERNIE-ViL`](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil) models are **avaliable** now!
+    - `ERNIE-UNIMO` will be released soon, [link](./ernie-unimo)
 
 - Dec.29.2020:
  	- Pretrain and finetune ERNIE with [PaddlePaddle v2.0](https://github.com/PaddlePaddle/Paddle/tree/release/2.0-rc).
diff --git a/README.zh.md b/README.zh.md
index 91bf3232867ec..93370d1d2a35a 100644
--- a/README.zh.md
+++ b/README.zh.md
@@ -11,11 +11,11 @@ ERNIE是百度开创性提出的基于知识增强的持续学习语义理解框
 # 新闻
 
 - 2021.5.20:
-   - ERNIE 开源家族又添生力军!
-      - 显式多粒度语言知识模型`ERNIE-Gram` [正式开源](./ernie_gram/)
+   - ERNIE 最新开源四大预训练模型:
+      - 多粒度语言知识模型`ERNIE-Gram` [正式开源](./ernie-gram/)
       - 超长文本双向建模预训练模型`ERNIE-Doc` [正式开源](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-doc)
       - 融合场景图知识的跨模态预训练模型`ERNIE-ViL` [正式开源](https://github.com/PaddlePaddle/ERNIE/tree/repro/ernie-vil)
-      - 语言与视觉一体的预训练模型`ERNIE-UNIMO` 将近期开源
+      - 语言与视觉一体的预训练模型`ERNIE-UNIMO` 将于[近期开源](./ernie-unimo/)
 
 - 2020.12.29:
    - `ERNIE`开源工具套件全面升级 [PaddlePaddle v2.0](https://github.com/PaddlePaddle/Paddle/tree/release/2.0-rc)