Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hip: disable VMM on hip as it seams that it dosent work in some configurations #11420

Merged
merged 1 commit into from
Jan 25, 2025

Conversation

IMbackK
Copy link
Collaborator

@IMbackK IMbackK commented Jan 25, 2025

Since it seams that this dosent work on some configurations #11405 and we have no way of telling which, lets disable this by default.

@github-actions github-actions bot added Nvidia GPU Issues specific to Nvidia GPUs ggml changes relating to the ggml tensor library for machine learning labels Jan 25, 2025
@@ -155,6 +155,7 @@ option(GGML_CUDA_GRAPHS "ggml: use CUDA graphs (llama.cpp on

option(GGML_HIP "ggml: use HIP" OFF)
option(GGML_HIP_GRAPHS "ggml: use HIP graph, experimental, slow" OFF)
option(GGML_HIP_NO_VMM "ggml: do not try to use HIP VMM" ON)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

At some point we should rename all the negative options (e.g. GGML_CUDA_NO_VMM -> GGML_CUDA_VMM) and set the default value accordingly instead. This is mostly an artifact from the time Makefile was used and didn't have a good way to set defaults.

@slaren slaren merged commit 26771a1 into ggerganov:master Jan 25, 2025
45 checks passed
anagri pushed a commit to BodhiSearch/llama.cpp that referenced this pull request Jan 26, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants