Skip to content

Commit

Permalink
Allow passing of can_stream in openai_models.py
Browse files Browse the repository at this point in the history
Fixes simonw#599 

A longer term fix would be to use something like Pydantic so we don't repeat ourselves, but this would be a bit of a refactor
  • Loading branch information
cmungall authored Oct 31, 2024
1 parent a44ba49 commit 6a68078
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions llm/default_plugins/openai_models.py
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,7 @@ def register_models(register):
api_version = extra_model.get("api_version")
api_engine = extra_model.get("api_engine")
headers = extra_model.get("headers")
can_stream = extra_model.get("can_stream")
if extra_model.get("completion"):
klass = Completion
else:
Expand All @@ -71,6 +72,7 @@ def register_models(register):
api_version=api_version,
api_engine=api_engine,
headers=headers,
can_stream=can_stream,
)
if api_base:
chat_model.needs_key = None
Expand Down

0 comments on commit 6a68078

Please sign in to comment.