Code

Improve rpm check on keys #8301

Code

Merged

krrishdholakia merged 5 commits intomainBerriAI/litellm:mainfrom litellm_dev_02_05_2025_p3BerriAI/litellm:litellm_dev_02_05_2025_p3Copy head branch name to clipboardFeb 6, 2025

+92-140

Commits

Commits on Feb 6, 2025

• fix(parallel_request_limiter.py): initial commit that solves the rpm limit check on keys

  Show description for ac37834
  krrishdholakia

  committed
  ac37834

  Copy full SHA for ac37834

• fix(parallel_request_limiter.py): simpler approach - just increment RPM in pre call hook instead of on success

  krrishdholakia

  committed
  4ce0498

  Copy full SHA for 4ce0498

• fix(parallel_request_limiter.py): pass testing

  krrishdholakia

  committed
  1e974ff

  Copy full SHA for 1e974ff

• fix: fix linting error

  krrishdholakia

  committed
  17e6449

  Copy full SHA for 17e6449

• fix(parallel_request_limiter.py): fix parallel request check for keys

  krrishdholakia

  committed
  0e67f53

  Copy full SHA for 0e67f53