Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upstage Solar Pro Preview model is not supported #2960

Open
brankoradovanovic-mcom opened this issue Sep 16, 2024 · 1 comment
Open

Upstage Solar Pro Preview model is not supported #2960

brankoradovanovic-mcom opened this issue Sep 16, 2024 · 1 comment
Labels
bug-unconfirmed chat gpt4all-chat issues

Comments

@brankoradovanovic-mcom
Copy link

When trying to use Solar Pro Preview (Maziyar Panahi's Q5_K_M GGUF), I'm largely getting incoherent responses:
image

Whether this is a problem with the GGUF or the inference logic is off, I can't tell. Anyone with a similar experience?

Your Environment

@brankoradovanovic-mcom
Copy link
Author

Apparently not yet supported in llama.cpp, see ggerganov/llama.cpp#9541. Mistral Nemo is also pending: ggerganov/llama.cpp#8577.

@brankoradovanovic-mcom brankoradovanovic-mcom changed the title Upstage Solar Pro Preview model is incoherent Upstage Solar Pro Preview model is not supported Oct 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-unconfirmed chat gpt4all-chat issues
Projects
None yet
Development

No branches or pull requests

1 participant