You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the below "Relevant log output", you can see model_max_budget":{} in the response, even though I specified "model_max_budget": {"anthropic.claude-3-5-sonnet-20240620-v1:0": 1.0, "anthropic.claude-3-haiku-20240307-v1:0": 1.0} in the request
The problem is here, where we are not returning all of the parameters when creating our NewUserResponse.
What happened?
In the below "Relevant log output", you can see
model_max_budget":{}
in the response, even though I specified"model_max_budget": {"anthropic.claude-3-5-sonnet-20240620-v1:0": 1.0, "anthropic.claude-3-haiku-20240307-v1:0": 1.0}
in the requestThe problem is here, where we are not returning all of the parameters when creating our
NewUserResponse
.litellm/litellm/proxy/management_endpoints/internal_user_endpoints.py
Line 200 in 5a81bcd
It seems several other fields like
model_rpm_limit
andmodel_tpm_limit
are missing as well.Relevant log output
Are you a ML Ops Team?
No
What LiteLLM version are you on ?
v1.53.1
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: