-
-
Notifications
You must be signed in to change notification settings - Fork 97
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for listing running Ollama models #451
Conversation
Thanks for the PR @HavenDV! |
enum: | ||
- stop # The generation hit a stop token. | ||
- length # The maximum num_tokens was reached. | ||
- load # The request was sent with an empty body to load the model. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I would prefer to keep it as an enum, otherwise it makes it more cumbersome to get the actual value.
I don't expect these values to change much. And if they do change, the client won't crash, it will just return null for the new type until it is added to the list.
enum: | ||
- creating system layer | ||
- parsing modelfile | ||
- success |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same here
anyOf: | ||
- type: string | ||
- type: string | ||
enum: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
same here
anyOf: | ||
- type: string | ||
- type: string | ||
enum: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
and same here
I've made some minor changes that address some of the comments. I'll merge it for now to add support for |
Regarding AnyOf - I did the same as it is done in the OpenAI OpenAPI specification, this will allow users to be able to access new values from the SDK without the need to update, and also makes it possible to do more correct logging of what is happening because there are values like this (for PullModel) |
Co-authored-by: David Miguel <me@davidmiguel.com>
Co-authored-by: David Miguel <me@davidmiguel.com>
No description provided.