KoboldCPP-v1.82.1.yr0-ROCm

[YellowRoseCx]

---

This discussion was created from the release KoboldCPP-v1.82.1.yr0-ROCm.

[TheLapinMalin]

Hi,

I'm seeing this error with a 6750XT. I read here (#80) that this popped up a few months ago, but is it still an issue for anyone else?

ROCm error: CUBLAS_STATUS_INTERNAL_ERROR
  current device: 0, in function ggml_cuda_mul_mat_batched_cublas at D:/a/koboldcpp-rocm/koboldcpp-rocm/ggml/src/ggml-cuda/ggml-cuda.cu:1719
  hipblasGemmBatchedEx(ctx.cublas_handle(), HIPBLAS_OP_T, HIPBLAS_OP_N, ne01, ne11, ne10, alpha, (const void **) (ptrs_src.get() + 0*ne23), HIPBLAS_R_16F, nb01/nb00, (const void **) (ptrs_src.get() + 1*ne23), HIPBLAS_R_16F, nb11/nb10, beta, ( void **) (ptrs_dst.get() + 0*ne23), cu_data_type, ne01, ne23, cu_compute_type, HIPBLAS_GEMM_DEFAULT)
D:/a/koboldcpp-rocm/koboldcpp-rocm/ggml/src/ggml-cuda/ggml-cuda.cu:73: ROCm error

PS: For info, v1.80.3 also fails for me. The latest release that works is v1.79.1.yr1.