You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are API models that do not support streaming (specifically OpenAI o1) but our backend always sets the streaming flag to true. Similarly, there are now API models that support non-image attachments (specifically Claude Sonnet) but our app only allows you to attach images.
We should migrate the langauge_model table to have two new booleans, maybe called supports_streaming (default to true) and supports_pdfs (default to false).
Then our language model settings page should have checkboxes for these.
Then our app internals should be updated to reflect these.
No problem. And I actually think we should drop the streaming boolean flag idea. OpenAI just announced that they’re new o3 model now supports streaming, and this makes their o1 model obsolete.
There are API models that do not support streaming (specifically OpenAI o1) but our backend always sets the streaming flag to true. Similarly, there are now API models that support non-image attachments (specifically Claude Sonnet) but our app only allows you to attach images.
We should migrate the langauge_model table to have two new booleans, maybe called
supports_streaming
(default to true) andsupports_pdfs
(default to false).Then our language model settings page should have checkboxes for these.
Then our app internals should be updated to reflect these.
Anyone want to take this one?
@mattlindsey @duckworth @papayalabs @drnic @voodoo @sergiobayona
The text was updated successfully, but these errors were encountered: