Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

lora微调后再awq量化，报错， 详细如下： #2318

Open
gracelinlin opened this issue Oct 23, 2024 · 5 comments
Open

lora微调后再awq量化，报错， 详细如下： #2318

gracelinlin opened this issue Oct 23, 2024 · 5 comments
Labels
enhancement New feature or request

Comments

@gracelinlin
Copy link

gracelinlin commented Oct 23, 2024 •
edited
Loading

No description provided.

@Jintao-Huang
Copy link
Collaborator

报错信息嘞

@gracelinlin
Copy link
Author

报错信息嘞

我发现是 autoAWQ的报错， issue url: best_ratio
这个bug提了2个月了没有优化
我们 swift 可以自已支持awq量化吗？

@Jintao-Huang
Copy link
Collaborator

可以自己写awq量化的逻辑.

可能会做. awq好像不太维护了

@Jintao-Huang Jintao-Huang added the enhancement New feature or request label Nov 9, 2024
@Jintao-Huang Jintao-Huang changed the title lora微调后再量化，报错， 详细如下： lora微调后再awq量化，报错， 详细如下： Nov 9, 2024
@ransheng11
Copy link

ransheng11 commented Jan 10, 2025 •
edited
Loading

@Jintao-Huang 你好请问这个问题有优化吗，我数据集是视频
image

@Jintao-Huang
Copy link
Collaborator

请使用gptq量化

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@gracelinlin @Jintao-Huang @ransheng11