You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I attempt to quan the deepseek-v2-lite. throw the error: “auto_gptq/nn_modules/qlinear/qlinear_exllama.py", line 64, in init
assert infeatures % self.group_size == 0
AssertionError”
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
https://huggingface.co/deepseek-ai/DeepSeek-V2-Chat

The text was updated successfully, but these errors were encountered: