Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support stableCode models (which seems to be gpt-neo-x that we can convert into gguf) #4174

Closed
maddes8cht opened this issue Nov 22, 2023 · 1 comment
Labels
bug-unconfirmed duplicate This issue or pull request already exists

Comments

@maddes8cht
Copy link
Contributor

Why can we build gpt-neo-x models with the convert-hf-to-gguf.py script when there is no code to run it?

Mentioned in #3838 an d #3293, we do have code to convert gpt-neo-x models into gguf models, but no code to run inference.

As i noticed, even the not too old stbilityAI stablecode models seems to be gpt-neo-x models, ad the convert-hf-to-gguf converts them, but there is no way to use them.

@Galunid Galunid added the duplicate This issue or pull request already exists label Nov 22, 2023
@Galunid Galunid closed this as completed Nov 22, 2023
@Galunid
Copy link
Collaborator

Galunid commented Nov 22, 2023

I'll close it since there's already gpt-neox ticket, supporting that will solve this too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-unconfirmed duplicate This issue or pull request already exists
Projects
None yet
Development

No branches or pull requests

2 participants