[Fix] /key/delete + add delete cache keys #1788

ishaan-jaff · 2024-02-03T02:43:11Z

Changes

Fixes bug where deleted keys could be used for using the server
Added tests for ensuring we cache only hashed tokens
Add delete_cache(self, key) for litellm.caching

UI Improvements

Show user error messages on /user/info & /user/delete
Show user error on /user/info endpoint
Don’t show the temporary key we create to access the UI
Don’t fail when user has no DB connected: [Feature]: Admin UI - Quick Spin Up, when no DB URL set #1778

railway-app · 2024-02-03T02:43:16Z

This PR is being deployed to Railway 🚅

litellm: ◻️ REMOVED

vercel · 2024-02-03T02:43:17Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 3, 2024 4:19am
litellm-dashboard	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 3, 2024 4:19am

…pdate

…mage gen test

…letion key info test

ishaan-jaff added 4 commits February 2, 2024 18:36

(feat) - cache - add delete cache

4d6ffe4

(fix) proxy - clear cache after /key/delete

9852462

(ui) improve message on deleting keys

aa55da8

(fix) ui

cf41366

(test) state of litellm cache after create, delete

3899361

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 02:51 View deployment

vercel bot deployed to Preview – litellm February 3, 2024 02:51 View deployment

(ci/cd) run again

d7d1aa1

vercel bot deployed to Preview – litellm February 3, 2024 02:56 View deployment

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 02:57 View deployment

krrishdholakia added 9 commits February 2, 2024 19:03

fix(proxy_server.py): don't silently fail load_team_config

688193b

fix(main.py): for health checks, don't use cached responses

ddf3e51

fix(test_key_generate_prisma.py): add longer delay to allow logs to u…

c997d4b

…pdate

test(test_caching.py): fix test to check id

c0699b0

test(test_image_generation.py): ignore content violation errors for i…

142e7cf

…mage gen test

fix(proxy_server.py): load default team config straight from config file

1f0598a

docs(vertex.md): adding vertex ai model garden support to docs

3572f35

test(test_completion.py): skip flaky test

3aab719

test(test_keys.py): separate streaming key info test from normal comp…

bfe2faa

…letion key info test

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 03:04 View deployment

vercel bot deployed to Preview – litellm February 3, 2024 03:05 View deployment

ishaan-jaff mentioned this pull request Feb 3, 2024

[Feature]: Proxy - delete keys still work (Cached) #1775

Closed

(fix) show error in test_keys

419bdda

vercel bot deployed to Preview – litellm February 3, 2024 03:15 View deployment

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 03:16 View deployment

(fix) /key/info test

42fcce4

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 03:24 View deployment

vercel bot deployed to Preview – litellm February 3, 2024 03:25 View deployment

(fix) ui

34a0e4d

vercel bot deployed to Preview – litellm February 3, 2024 03:27 View deployment

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 03:28 View deployment

(fix) ui - don't show litellm-admin-keys

d19a9e8

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 03:32 View deployment

vercel bot deployed to Preview – litellm February 3, 2024 03:33 View deployment

ishaan-jaff added 2 commits February 2, 2024 19:57

(test) user_api_key_auth_cache

ae95e4c

(fix) improve proxy api_key caching

cfec3c6

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 04:00 View deployment

vercel bot deployed to Preview – litellm February 3, 2024 04:00 View deployment

(ui) update ui build

ed048fb

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 04:09 View deployment

vercel bot deployed to Preview – litellm February 3, 2024 04:10 View deployment

(fix) ui - don't fail when no DB connected

ebb221f

vercel bot deployed to Preview – litellm February 3, 2024 04:18 View deployment

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 04:19 View deployment

ishaan-jaff mentioned this pull request Feb 3, 2024

[Feature]: Admin UI - Quick Spin Up, when no DB URL set #1778

Closed

ishaan-jaff merged commit 6950f99 into main Feb 3, 2024
5 of 8 checks passed

ishaan-jaff deleted the litellm_fix_delete_key branch February 3, 2024 04:22

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Fix] /key/delete + add delete cache keys #1788

[Fix] /key/delete + add delete cache keys #1788

ishaan-jaff commented Feb 3, 2024 •

edited

Loading

railway-app bot commented Feb 3, 2024 •

edited

Loading

vercel bot commented Feb 3, 2024 •

edited

Loading

[Fix] /key/delete + add delete cache keys #1788

[Fix] /key/delete + add delete cache keys #1788

Conversation

ishaan-jaff commented Feb 3, 2024 • edited Loading

Changes

UI Improvements

railway-app bot commented Feb 3, 2024 • edited Loading

vercel bot commented Feb 3, 2024 • edited Loading

ishaan-jaff commented Feb 3, 2024 •

edited

Loading

railway-app bot commented Feb 3, 2024 •

edited

Loading

vercel bot commented Feb 3, 2024 •

edited

Loading