Skip to content

Commit

Permalink
[Bugfix] Offline example of disaggregated prefill (vllm-project#13214)
Browse files Browse the repository at this point in the history
  • Loading branch information
XiaobingSuper authored and kerthcet committed Feb 21, 2025
1 parent 7a3a1c9 commit 061be6f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/offline_inference/disaggregated_prefill.py
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ def run_prefill(prefill_done):
# and 3 and do prefilling on request 2.
prompts = [
"Hello, my name is",
# "Hi, your name is",
"Hi, your name is",
# The decode node will actually "prefill" this request.
"Tell me a very long story",
]
Expand Down

0 comments on commit 061be6f

Please sign in to comment.