KoboldCpp - Version 1.76.yr1-ROCm stopped working using HipBLAS

[monk-insane]

Hi there,

Been using for a while, when it all of a sudden stopped working. (AMD R7 5800XT + RX 7800 XT)

Not sure what happened. Runs just fine if I select Vulcan - but HipBlas stopped working today.

Error I'm getting is:

`Loading model: E:\Mod Organizer 2\Skyrim SE\Tools\KoboldCPP\Chimera-Apex-7B.Q6_K.gguf

The reported GGUF Arch is: llama
Arch Category: 0

Identified as GGUF model: (ver 6)
Attempting to Load...

Using automatic RoPE scaling for GGUF. If the model has custom RoPE settings, they'll be used directly instead!
It means that the RoPE values written above will be replaced by the RoPE values indicated after loading.
System Info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | AVX512_BF16 = 0 | FMA = 1 | NEON = 0 | SVE = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | RISCV_VECT = 0 | WASM_SIMD = 0 | BLAS = 1 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 | LLAMAFILE = 0 |
Traceback (most recent call last):
File "koboldcpp.py", line 4937, in
File "koboldcpp.py", line 4580, in main
File "koboldcpp.py", line 890, in load_model
OSError: exception: access violation reading 0x0000000000000000
[9448] Failed to execute script 'koboldcpp' due to unhandled exception!`

[monk-insane]

OK IT seems my problem is the same one as this one: #58

Using [KoboldCPP-v1.67.yr0-ROCm] fixes issue and is also lightning fast. Using the allv3 exe for my RX 7800 XT

Seems that versions after this has an issue with Lama-based models.