Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Dev] Transform 3rdparty tvm from bitblas into bitblas_tl #95

Merged
merged 60 commits into from
Jul 22, 2024
Merged

[Dev] Transform 3rdparty tvm from bitblas into bitblas_tl #95

merged 60 commits into from
Jul 22, 2024

Conversation

LeiWang1999
Copy link
Contributor

@LeiWang1999 LeiWang1999 commented Jul 22, 2024 •
edited
Loading

To enhance performance, we might explore utilizing pure cut code generation over CUDA to unlock potential optimization opportunities.

Thus we merge changes from microsoft tl, thus we can also supports more complex expressions like group moe and flash attention

TODO Items

  • checkout whether the test can be passed.

@LeiWang1999
Refactor BatchMatMulEmitter and BatchMatMulSelector for improved read…
d8884e6 
…ability and maintainability
@LeiWang1999
Refactor import statements for improved readability and maintainability
fc84173
@LeiWang1999
Refactor import statements for improved readability and maintainability
02f64de
@LeiWang1999
disable failure email for ci
397eee6
@LeiWang1999
remove email notifications.
20f6ad1
@LeiWang1999
move relax pass from testing to mlc_llm
b93c394
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into main
ba6a6df
@LeiWang1999
Refactor scripts with se check_eual_ref_scripts_with_emitter function
257693a
@LeiWang1999
Lint Fix
9bb7f49
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into main
39e7614
@LeiWang1999
Refactor scripts with se check_eual_ref_scripts_with_emitter function
93eb5a5
@LeiWang1999
bug fix in test
aa66a90
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
ae14a53
@LeiWang1999
lint fix.
79b08e4
@LeiWang1999
test cuda i4 kernel
86fd036
@LeiWang1999
Refactor copyright notice in i4matmul.hpp
6b73a21
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
0ba90c1
@LeiWang1999
Refactor BitBLASLinear test module for improved readability and maint…
086d208 
…ainability
@LeiWang1999
refactor test as version below python 3.9 cannot handle int32 overflow.
47a3abd
@LeiWang1999
format lint for test
024b247
@LeiWang1999
Refactor test_int4b_fp16_convert.py for improved readability and main…
bfedeaa 
…tainability
@LeiWang1999
remove unused design file
e672a23
@LeiWang1999
move tile device from package to base
21e5430
@LeiWang1999
dummy impl for codegen
fd11940
@LeiWang1999
Refactor file structure for ladder_permutate module
9ccfa85
@LeiWang1999
Refactor backend class and fix typos in comments
7c7d73e
@LeiWang1999
Deep refactor Lib related code.
47d5fc5
@LeiWang1999
remove ci pull.
53dd0dd
@LeiWang1999
LintFix
d58ac43
@LeiWang1999
refactor builder for whl build
37cb07c
@LeiWang1999
lint fix
706e227
@LeiWang1999
BitNet vllm integration
63f5515
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
de91c0d
@LeiWang1999
chore: update codespell to version 2.3.0
b9655fd
@LeiWang1999
Lintfix
fff385f
@LeiWang1999
Bump version to 0.0.1.dev13
72a98e7
@LeiWang1999
lint fix
5646ab5
@LeiWang1999
disable fast decoding [u]int4xint8 by default.
b965863
@LeiWang1999
optimize from dict design in Hint
1198fc7
@LeiWang1999
Implement SplitK
014213c
@LeiWang1999
bitnet benchmark generation.
e0ca752
@LeiWang1999
Add benchmark script for BitNet integration
81b9cf0
@LeiWang1999
AtomicAdd Support
02edc0b
@LeiWang1999
LintFix
1a70c2d
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
28d851c
@LeiWang1999
ci fix when 3rdparty tvm is initialized.
c447a95
@LeiWang1999
bug fix for setup
79a001b
@LeiWang1999
fix a bug in block reduce
31813b2
@LeiWang1999
typo fix
78b6a3d
@LeiWang1999
BUG Fix for block reduce.
9c55218
@LeiWang1999
Lint fix
1aa8868
@LeiWang1999
Merge branch 'main' of https://github.com/Microsoft/BitBLAS into dev
22f70bf
@LeiWang1999
Refactor block reduce schedule template
5f082a5
@LeiWang1999
transform branch from bitblas to bitblas_tl
b4fb31e
@LeiWang1999
Fix subproject commit reference in 3rdparty/tvm
35eaa00
@LeiWang1999
chore: update submodule branch from bitblas to bitblas_tl
254dd74
@LeiWang1999
force update config.cmake
31a44aa
@LeiWang1999
Bug fix
427800e
@LeiWang1999 LeiWang1999 marked this pull request as ready for review July 22, 2024 12:59
@LeiWang1999 LeiWang1999 merged commit e1e30d7 into microsoft:main Jul 22, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@LeiWang1999