New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Qwen2.5-72B-Instruct-GPTQ-Int4 偶尔会出现无限循环输出问题 #415

Open

tianyunzqs opened this issue Dec 12, 2024 · 1 comment

tianyunzqs commented Dec 12, 2024

Qwen2.5-72B-Instruct-GPTQ-Int4用vllm部署的，但是接入Qwen-Agent后，偶尔会出现循环输出的情况

Collaborator

tuhahaha commented Dec 12, 2024

请问调用普通问答接口，不用qwen-agent会出现无限循环吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment