Can I run Alpaca-LoRA 7b on my GPU on windows?

[SLB13]

Hello, I cloned and ran the Alpaca-LoRA 7b model, and it worked fine on the gradio interface, the only problem is that it's running on my CPU, and I have an Nvidia 3080 GPU.

When I run the command:

python generate.py --load_8bit --base_model 'decapoda-research/llama-7b-hf' --lora_weights 'tloen/alpaca-lora-7b'

I get the following message:

bin C:\Users\Max\AppData\Local\Programs\Python\Python311\Lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so
C:\Users\Max\AppData\Local\Programs\Python\Python311\Lib\site-packages\bitsandbytes\cextension.py:34: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
  warn("The installed version of bitsandbytes was compiled without GPU support. "
'NoneType' object has no attribute 'cadam32bit_grad_fp32'
CUDA SETUP: Loading binary C:\Users\Max\AppData\Local\Programs\Python\Python311\Lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
argument of type 'WindowsPath' is not iterable
The tokenizer class you load from this checkpoint is not the same type as the class this function is called from. It may result in unexpected tokenization.
The tokenizer class you load from this checkpoint is 'LLaMATokenizer'.
The class this function is called from is 'LlamaTokenizer'.
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████| 33/33 [00:32<00:00,  1.03it/s]
C:\Users\Max\AppData\Local\Programs\Python\Python311\Lib\site-packages\gradio\inputs.py:27: UserWarning: Usage of gradio.inputs is deprecated, and will not be supported in the future, please import your component from gradio.components
  warnings.warn(
C:\Users\Max\AppData\Local\Programs\Python\Python311\Lib\site-packages\gradio\inputs.py:30: UserWarning: `optional` parameter is deprecated, and it has no effect
  super().__init__(
C:\Users\Max\AppData\Local\Programs\Python\Python311\Lib\site-packages\gradio\inputs.py:30: UserWarning: `numeric` parameter is deprecated, and it has no effect
  super().__init__(
Running on local URL:  http://0.0.0.0:7860

I tried installing the latest GPU drivers and CUDA version, but I still get this message, and also when I run python -m bitsandbytes

Any idea on how I can get the model to run on the GPU instead of the CPU?