Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Lora base routing algorithm #303

Closed
Jeffwan opened this issue Oct 17, 2024 · 0 comments · Fixed by #543
Closed

Support Lora base routing algorithm #303

Jeffwan opened this issue Oct 17, 2024 · 0 comments · Fixed by #543
Assignees
@Aspirin96 @chenzuzhi22
Labels
area/lora priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
Milestone
v0.2.0

Comments

@Jeffwan
Copy link
Collaborator

Jeffwan commented Oct 17, 2024

🚀 Feature Description and Motivation

separate task from #22.

Use Case

No response

Proposed Solution

No response
@Jeffwan Jeffwan added this to the v0.2.0 milestone Oct 17, 2024
@Jeffwan Jeffwan mentioned this issue Oct 17, 2024
Closed
8 tasks
@Jeffwan Jeffwan added area/lora priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Nov 13, 2024
@Aspirin96 Aspirin96 mentioned this issue Dec 27, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Aspirin96 Aspirin96

@chenzuzhi22 chenzuzhi22

Labels
area/lora priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release.
Projects
None yet
Milestone
v0.2.0
Development

Successfully merging a pull request may close this issue.

add request routers - least kv cache, least expected latency vllm-project/aibrix
3 participants
@Jeffwan @Aspirin96 @chenzuzhi22