Skip to content

Comparing the inference performance of TVM kernel tuning, Ansor and TensorRT on ResNet

License

Notifications You must be signed in to change notification settings

jc-su/tvm_tensorrt

Repository files navigation

Contributors Forks Stargazers Issues MIT License LinkedIn


TVM TensorRT Deployment Performance Comparison

Install dependencies

sudo apt install opencv

Installing TensorRT from this link

Installing TVM form TVM tutorial

Make sure to set set(USE_LLVM ON) and set(USE_CUDA ON) in build/config.cmake

How to build

git clone --recursive https://github.com/jc-su/tvm_tensorrt_comparsion
mkdir build
cd build
cmake ..
make $(nproc)

About

Comparing the inference performance of TVM kernel tuning, Ansor and TensorRT on ResNet

Resources

License

Stars

Watchers

Forks

Releases

No releases published