Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot change temperature / other options, with bind or on invoke #389

Open
krodyrobi opened this issue Dec 19, 2024 · 0 comments
Open

Cannot change temperature / other options, with bind or on invoke #389

krodyrobi opened this issue Dec 19, 2024 · 0 comments
Labels
feature request New feature or request

Comments

@krodyrobi
Copy link

krodyrobi commented Dec 19, 2024

Describe the Problem

We cannot change the default temperature set on a model at creation per model invocation, neither as an option to invoke nor as a bind change.

Propose a Solution

Base implementation of sdk chat model on @langchain/oneai models.
On first glace they seem to handle this.

Describe Alternatives

Configure 2 models and use them interchangeably, since the end http client is shared and discovery is shared/cached it should work.
But this gets nasty if we want to provide several gpt versions doubling possibly active models needed.

Affected Development Phase

Development

Impact

Inconvenience

Timeline

Next months

Additional Context

No response

@krodyrobi krodyrobi added the feature request New feature or request label Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant