Code

llama : cache llama_token_to_piece#7587

Code

Merged

mofosyne merged 4 commits intomasterggerganov/llama.cpp:masterfrom gg/cache-token-to-pieceggerganov/llama.cpp:gg/cache-token-to-pieceCopy head branch name to clipboardMay 30, 2024

+119-84

Commits

Commits on May 29, 2024

• llama : cache llama_token_to_piece

  Show description for 9964cd0
  ggerganov

  committed
  9964cd0

  Copy full SHA for 9964cd0

• llama : use vectors and avoid has_cache

  Show description for 21ccd64
  ggerganov

  committed
  21ccd64

  Copy full SHA for 21ccd64

• llama : throw on unknown tokenizer types

  Show description for 1494a18
  ggerganov

  committed
  1494a18

  Copy full SHA for 1494a18

• llama : print a log of the total cache size

  ggerganov

  committed
  8a8f8b9

  Copy full SHA for 8a8f8b9