Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix(proxy_server.py): speed up proxy startup time #1696

Merged
merged 2 commits into from
Jan 31, 2024
Merged

fix(proxy_server.py): speed up proxy startup time #1696

merged 2 commits into from
Jan 31, 2024

Conversation

krrishdholakia
Copy link
Contributor

Addresses - #1636

  • Makes master key and proxy budget db additions asyncio.create_tasks
  • adds these values to cache, so they're still accessible

@railway-app Railway App
Copy link

railway-app bot commented Jan 31, 2024 •
edited
Loading

This PR is being deployed to Railway 🚅

litellm: ◻️ REMOVED

@vercel Vercel
Copy link

vercel bot commented Jan 31, 2024 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 31, 2024 3:00am
litellm-dashboard ✅ Ready (Inspect) Visit Preview 💬 Add feedback Jan 31, 2024 3:00am

@krrishdholakia krrishdholakia merged commit 67bb118 into main Jan 31, 2024
7 checks passed
@krrishdholakia krrishdholakia deleted the litellm_proxy_cold_start_Time branch January 31, 2024 05:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@krrishdholakia