Code

[vLLM] add prefix caching support#2239

Code

Merged

lanking520 merged 2 commits intodeepjavalibrary:masterdeepjavalibrary/djl-serving:masterfrom lanking520:fixlanking520/djl-serving:fixCopy head branch name to clipboardJul 30, 2024

+10-1

Commits

Commits on Jul 30, 2024

• add prefix caching support

  

  Qing Lan

  committed
  521b0dc

  Copy full SHA for 521b0dc

• add deepseek

  

  Qing Lan

  committed
  110ddf5

  Copy full SHA for 110ddf5