Skip to content

Commit

Permalink
Update benchmark figures and add INT8xUINT1 Matmul BS Scaling on A100.
Browse files Browse the repository at this point in the history
  • Loading branch information
LeiWang1999 committed Apr 18, 2024
1 parent 4be608a commit 959cd77
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions benchmark/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -84,10 +84,6 @@ BitNET 1.58B INT8xINT2 Matmul BS Scaling on A100.

![int8xiint2_scaling](../images/figures/op_benchmark_a100_int2_scaling.png)

INT8xUINT1 Matmul BS Scaling on A100.

![int8xiint1_scaling](../images/figures/op_benchmark_a100_uint1_scaling.png)

3090 Related benchmark numbers

![3090-gemm-fp16](../images/figures/op_benchmark_3090_fp16_gemm.png)
Expand All @@ -103,3 +99,7 @@ A100 Related Benchmark Result
![a100-wq-gemv](../images/figures/op_benchmark_a100_wq_gemv_e8.png)

![a100-wq-gemm](../images/figures/op_benchmark_a100_wq_gemm_e8.png)

INT8xUINT1 Matmul BS Scaling on A100.

![int8xiint1_scaling](../images/figures/op_benchmark_a100_uint1_scaling.png)

0 comments on commit 959cd77

Please sign in to comment.