Litellm cost tracking caching fixes (should be 0.0) #1786

krrishdholakia · 2024-02-03T01:34:28Z

Addresses - #1783

railway-app · 2024-02-03T01:34:31Z

This PR is being deployed to Railway 🚅

vercel · 2024-02-03T01:34:35Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 3, 2024 2:04am
litellm-dashboard	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Feb 3, 2024 2:04am

krrishdholakia added 2 commits February 2, 2024 16:51

fix(main.py): for health checks, don't use cached responses

62ad6f1

fix(utils.py): fix cost tracking for cache hits (should be 0)

1ed6842

vercel bot deployed to Preview – litellm February 3, 2024 01:34 View deployment

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 01:35 View deployment

test(test_key_generate_prisma.py): add longer sleep time

92b0a4c

vercel bot deployed to Preview – litellm February 3, 2024 02:04 View deployment

vercel bot deployed to Preview – litellm-dashboard February 3, 2024 02:04 View deployment

krrishdholakia merged commit 38a299a into main Feb 3, 2024
6 of 7 checks passed

krrishdholakia deleted the litellm_cost_tracking_caching_fixes branch February 3, 2024 03:23

Provide feedback