[BUG/Help] <title>line 316, in extract_weight_to_float func( TypeError: 'NoneType' object is not callable

[xiaoming521]

Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 80, in forward
weight = extract_weight_to_float(quant_w, scale_w, weight_bit_width, quantization_cache=quantization_cache)
File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 316, in extract_weight_to_float
func(
TypeError: 'NoneType' object is not callable

Expected Behavior

File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 80, in forward
weight = extract_weight_to_float(quant_w, scale_w, weight_bit_width, quantization_cache=quantization_cache)
File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 316, in extract_weight_to_float
func(
TypeError: 'NoneType' object is not callable

Steps To Reproduce

File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 80, in forward
weight = extract_weight_to_float(quant_w, scale_w, weight_bit_width, quantization_cache=quantization_cache)
File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 316, in extract_weight_to_float
func(
TypeError: 'NoneType' object is not callable

Environment

- OS:Window7
- Python:3.8
- Transformers:4.27.1
- PyTorch: 1.10
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :no

Anything else?

File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 80, in forward
weight = extract_weight_to_float(quant_w, scale_w, weight_bit_width, quantization_cache=quantization_cache)
File "C:\Users\19027387/.cache\huggingface\modules\transformers_modules\chatglm-6b-4\quantization.py", line 316, in extract_weight_to_float
func(
TypeError: 'NoneType' object is not callable