Code

Add miscellaneous updates#8

Code

Merged

WoosukKwon merged 6 commits intomainvllm-project/vllm:mainfrom minorvllm-project/vllm:minorCopy head branch name to clipboardMar 13, 2023

+44-22

Commits

Commits on Mar 13, 2023

• Handle empty inputs

  WoosukKwon

  committed
  e58e731

  Copy full SHA for e58e731

• Minor

  WoosukKwon

  committed
  63ba824

  Copy full SHA for 63ba824

• Add namespace

  WoosukKwon

  committed
  d7eb2e0

  Copy full SHA for d7eb2e0

• Default batch size 2048 -> 2560

  WoosukKwon

  committed
  d02d394

  Copy full SHA for d02d394

• memory utilization -> swap space

  WoosukKwon

  committed
  532365e

  Copy full SHA for 532365e

• Fetch requests every step

  WoosukKwon

  committed
  d87b2b0

  Copy full SHA for d87b2b0