Code

[pull] master from ggerganov:master#141

Code

Closed

pull[bot] wants to merge 11 commits intoteleprint-me:masterteleprint-me/llama.cpp:masterfrom ggerganov:masterggerganov/llama.cpp:masterCopy head branch name to clipboard

+1,380-91

Commits

Commits on Aug 11, 2024

• Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. (#8943)

  Show description for 7c5bfd5
  

  mtavenrath

  and

  0cc4m

  authored
  7c5bfd5

  Copy full SHA for 7c5bfd5

• llama : check all graph nodes when searching for result_embd_pooled (#8956)

  Show description for 33309f6
  

  fairydreaming

  and

  sszymczy

  authored
  33309f6

  Copy full SHA for 33309f6

• update guide (#8909)

  Show description for a21c6fd
  arthw

  authored
  a21c6fd

  Copy full SHA for a21c6fd

• flake.lock: Update (#8979)

  ggerganov

  authored
  8cd1bcf

  Copy full SHA for 8cd1bcf

• gguf-py : Numpy dequantization for most types (#8939)

  Show description for 4134999
  compilade

  authored
  4134999

  Copy full SHA for 4134999

Commits on Aug 12, 2024

• server : handle models with missing EOS token (#8997)

  Show description for 5ef07e2
  ggerganov

  authored
  5ef07e2

  Copy full SHA for 5ef07e2

• py : fix requirements check '==' -> '~=' (#8982)

  Show description for d3ae0ee
  ggerganov

  authored
  d3ae0ee

  Copy full SHA for d3ae0ee

• Fix a spelling mistake (#9001)

  Septa2112

  authored
  2589292

  Copy full SHA for 2589292

• ggml: fix div-by-zero (#9003)

  Show description for df5478f
  DavidKorczynski

  authored
  df5478f

  Copy full SHA for df5478f

• grammar-parser : fix possible null-deref (#9004)

  Show description for 1262e7e
  DavidKorczynski

  authored
  1262e7e

  Copy full SHA for 1262e7e

• docs: introduce gpustack and gguf-parser (#8873)

  Show description for 84eb2f4
  thxCode

  authored
  84eb2f4

  Copy full SHA for 84eb2f4