Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] 增加 自定义模型参数 添加功能 #2176

Open
ghcoba opened this issue Mar 21, 2025 · 0 comments
Open

[Feature] 增加 自定义模型参数 添加功能 #2176

ghcoba opened this issue Mar 21, 2025 · 0 comments

Comments

@ghcoba
Copy link

ghcoba commented Mar 21, 2025

Problem Description
Please describe the issue or difficulty you are experiencing and why it makes using the software difficult or frustrating.

Proposed Solution
Please provide a clear and concise description of what you would like to see in terms of a function or solution.

Additional Context
Please provide any additional context or information that would help better understanding your feature request, such as screenshots, examples, or use cases.


问题描述
与模型交互需要使用一些 参数控制模型的输出特征。 例如: 使用 chunk_size 控制分块输出的尺寸, 避免因为max tokens 限制 造成输出被截断; 例如 使用 开启消息长度限制 设置 消息长度 (max_tokens),设置 max_tokens 用于防止数据因为 默认 的 max_tokens 限制,造成输出被截断。

解决思路
增加用户自定义模型参数的 功能,让用户增加自定义模型参数的功能。或者将 chunk_size,max_tokens 增加到可用用户设置的 默认模型参数列表中,用户设置后这是利用用户设置的参数,如果用户不设置这使用 chatbox 默认使用的参数。

附加上下文
类似 cherrystudio 应用中的 Assistant 设置中的模型参数设置中有类似的设置,例如:开启消息长度限制, 和 设置消息长度的设置; 使用自定义模型参数设置 可以设置 bool, int, string 类型的自定义参数 用户通过自定义参数控制模型输出特性。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant