name 'cuda_setup' is not defined

[ygbingo]

Hi,
I had made environment and download all nessesary files from readme and then I run demo command. python demo.py --cfg-path eval_configs/minigpt4_eval.yaml --gpu-id 0.

And I got this Error:

...
NameError: name 'cuda_setup' is not defined

I found this issue said I should use pip install bitsandbytes==0.35.0. But I found envrionment said I should use 0.37.0. I just want to make sure about this.

Thank you.

[norris9410]

Run "pip install -U bitsandbytes" to upgrade tp 0.38.1works for me.

[LLLYF]

Run "pip install -U bitsandbytes" to upgrade tp 0.38.1works for me.

Excuse me! I have another error.When I run this code, the terminal shows that:
RuntimeError:
CUDA Setup failed despite GPU being available.
My os is windows11 cuda==12.1. Is it error from the os or others...? If you have any idea, please tell me!

[bigbrother001]

while, maybe you should try linux. That is work for me

[JunnanDong]

Run "pip install -U bitsandbytes" to upgrade tp 0.38.1works for me.

This actually works, appreciated.

[MroutsideturnAF]

If you don't want to upgrade bitsandbytes, you can solve the error like this:
Naviagate to the pyton library bitsandbytes. For me it was here:
/usr/local/lib/python3.10/dist-packages/bitsandbytes/cuda_setup/main.py

Change:
cuda_setup..add_log_entry("WARNING: Compute capability < 7.5 detected! Only slow 8-bit matmul is supported for your GPU!", is_warning=True)
to -->
CUDASetup.get_instance().add_log_entry("WARNING: Compute capability < 7.5 detected! Only slow 8-bit matmul is supported for your GPU!", is_warning=True)