Code

add --mmap in llama-bench#5257

Code

Merged

slaren merged 7 commits intoggerganov:masterggerganov/llama.cpp:masterfrom NeoZhangJianyu:update_benchNeoZhangJianyu/llama.cpp:update_benchCopy head branch name to clipboardFeb 1, 2024

+89-10

Commits

Commits on Feb 1, 2024

• add --no-mmap, show sycl backend

  NeoZhangJianyu

  committed
  c36ecbf

  Copy full SHA for c36ecbf

• Merge branch 'master' into update_bench

  NeoZhangJianyu

  authored
  5ab6504

  Copy full SHA for 5ab6504

• fix conflict

  NeoZhangJianyu

  committed
  e4e28c1

  Copy full SHA for e4e28c1

• fix code format, change print for --no-mmap

  NeoZhangJianyu

  committed
  b2f6338

  Copy full SHA for b2f6338

• ren no_mmap to mmap, show mmap when not default value in printer

  NeoZhangJianyu

  committed
  fb69ed8

  Copy full SHA for fb69ed8

• update guide for mmap

  NeoZhangJianyu

  committed
  da32e21

  Copy full SHA for da32e21

• mv position to reduce model reload

  NeoZhangJianyu

  committed
  30c52f3

  Copy full SHA for 30c52f3