I am currently facing a problem and am seeking assistance. While using LoRa to train my llama2 model, I encountered this issue. Has anyone come across this before?
RuntimeError: CUDA Setup failed despite GPU being available. Please run the following command to get more information:
python -m bitsandbytes
Inspect the output of the command and see if you >can locate CUDA libraries. You might need to add them to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues
How can I solve this problem, or should I use another method？