Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

URL路径错了 #20

Open
lbwengineer opened this issue Oct 8, 2024 · 4 comments
Open

URL路径错了 #20

lbwengineer opened this issue Oct 8, 2024 · 4 comments
Labels
good first issue Good for newcomers

Comments

@lbwengineer
Copy link

SakuraLLV API RUL:http://127.0.0.1:8080/chat/completions

@ahuaiab
Copy link

ahuaiab commented Oct 10, 2024

设置这个url还是404报错
sakuraLLM模型的url不是这个吗?

@fkiliver fkiliver added the good first issue Good for newcomers label Oct 12, 2024
@ahuaiab
Copy link

ahuaiab commented Oct 13, 2024

设置这个url还是404报错 sakuraLLM模型的url不是这个吗?

http://127.0.0.1:8080/chat/completions 这个地址才是对的,release版的那个地址默认是 http://127.0.0.1:8080/completions,这是不对的。手动在 ini文件里修改就可以 http://127.0.0.1:8080/v1/chat/completions 这个地址也可以
设置为 http://127.0.0.1:8080/chat/completions or http://127.0.0.1:8080/v1/chat/completions 这两个地址
依然报错404
Net.WebException: The remote server returned an error: (404) Not Found.
request: POST /v1/chat/completions 127.0.0.1 404
request: POST /v1/chat/completion 127.0.0.1 404
ini文件设置如下
[Service]
Endpoint=SakuraTranslator
FallbackEndpoint=
[Sakura]
Endpoint=http://127.0.0.1:8080/chat/completions ##此处修改为你部署的Sakura模型监听的地址
MaxConcurrency=1
ApiType=Qwen ##OpenAI为kaggle上SakuraAPI,Qwen为本地Sakura 0.9模型,空置则为本地Sakura 0.8模型
UseDict=
DictMode=Full
Dict=

@fkiliver
Copy link
Owner

设置这个url还是404报错 sakuraLLM模型的url不是这个吗?

http://127.0.0.1:8080/chat/completions 这个地址才是对的,release版的那个地址默认是 http://127.0.0.1:8080/completions,这是不对的。手动在 ini文件里修改就可以 http://127.0.0.1:8080/v1/chat/completions 这个地址也可以
设置为 http://127.0.0.1:8080/chat/completions or http://127.0.0.1:8080/v1/chat/completions 这两个地址
依然报错404
Net.WebException: The remote server returned an error: (404) Not Found.
request: POST /v1/chat/completions 127.0.0.1 404
request: POST /v1/chat/completion 127.0.0.1 404
ini文件设置如下
[Service]
Endpoint=SakuraTranslator
FallbackEndpoint=
[Sakura]
Endpoint=http://127.0.0.1:8080/chat/completions ##此处修改为你部署的Sakura模型监听的地址
MaxConcurrency=1
ApiType=Qwen ##OpenAI为kaggle上SakuraAPI,Qwen为本地Sakura 0.9模型,空置则为本地Sakura 0.8模型
UseDict=
DictMode=Full
Dict=

你浏览器访问一下看看,webui可能访问地址不一样

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

3 participants