Code

Bamba VLLM Draft#2

Code

Draft

fabianlim wants to merge 9 commits intomainfabianlim/vllm:mainfrom pr-draftfabianlim/vllm:pr-draftCopy head branch name to clipboard

+5,256

Commits

Commits on Nov 29, 2024

• bamba draft

  Show description for 14d1683
  fabianlim

  committed
  14d1683

  Copy full SHA for 14d1683

Commits on Nov 30, 2024

• add test_bamba

  Show description for e26d327
  fabianlim

  committed
  e26d327

  Copy full SHA for e26d327

Commits on Dec 2, 2024

• rope fix for long sequence lengths

  Show description for 01ca5cd
  fabianlim

  committed
  01ca5cd

  Copy full SHA for 01ca5cd

• fix batching with seq_idx

  Show description for 1cd3c7a
  fabianlim

  committed
  1cd3c7a

  Copy full SHA for 1cd3c7a

Commits on Dec 3, 2024

• add comments on chunked prefill

  Show description for 1c1dbb4
  fabianlim

  committed
  1c1dbb4

  Copy full SHA for 1c1dbb4

Commits on Dec 5, 2024

• switch model and disable chunk prefill test

  Show description for dfdcf28
  fabianlim

  committed
  dfdcf28

  Copy full SHA for dfdcf28

• fix casting in rms norm gated

  Show description for 18d0176
  fabianlim

  committed
  18d0176

  Copy full SHA for 18d0176

Commits on Dec 6, 2024

• TP fix

  Show description for 02943e7
  fabianlim

  committed
  02943e7

  Copy full SHA for 02943e7

Commits on Dec 8, 2024

• fix mamba scan invalid address

  Show description for b3bf431
  fabianlim

  committed
  b3bf431

  Copy full SHA for b3bf431