We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses:
Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?
The text was updated successfully, but these errors were encountered:
Apparently not yet supported in llama.cpp, see ggerganov/llama.cpp#9541. Mistral Nemo is also pending: ggerganov/llama.cpp#8577.
Sorry, something went wrong.
No branches or pull requests
When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses:
Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?
Your Environment
The text was updated successfully, but these errors were encountered: