-
Notifications
You must be signed in to change notification settings - Fork 11k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
awq-py : remove #5768
awq-py : remove #5768
Conversation
@ggerganov looks like the functionality was referenced by convert.py ? I'm a bit confused now, does this repo support quantizing models with AWQ |
I just removed the leftovers from
|
Thanks @ggerganov. PS, I really want to know whats in your |
It's a bit of a mess, but here it is: https://github.com/ggerganov/ggterm |
I think this functionality never ended up being used, plus I think GGUF support was at some point implemented in the OG repo. So I think there is no reason to keep the code around