Skip to content

Commit

Permalink
refine doc
Browse files Browse the repository at this point in the history
  • Loading branch information
HIT-cwh committed Apr 16, 2024
1 parent 2ab53c4 commit 968e1ae
Showing 1 changed file with 39 additions and 0 deletions.
39 changes: 39 additions & 0 deletions docs/zh_cn/acceleration/triton_kernels.rst
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,45 @@
RMS Norm Triton Kernel
------------------------

RMS Norm Triton Kernel 支持情况
~~~~~~~~~~~

.. list-table::
:widths: 25 50
:header-rows: 1

* - 模型
- 支持情况
* - internlm 1/2
- ✅
* - llama 2
- ✅
* - mistral
- ✅
* - mixtral
- ✅
* - qwen 1/1.5
- ✅
* - starcoder
- ✅
* - yi
- ✅
* - zephyr
- ✅
* - deepseek
- ✅
* - baichuan 1/2
- ❌
* - chatglm 2/3
- ❌
* - gemma
- ❌
* - cohere (no RMS Norm)
- ❌

加速情况
~~~~~~~~~~~

下表展示了 Qwen 1.5 0.5B 在 Alpaca 数据集上的训练效率对比:

.. list-table::
Expand Down

0 comments on commit 968e1ae

Please sign in to comment.