Code

llama : refactor unicode stuff#5992

Code

Merged

ggerganov merged 11 commits intomasterggerganov/llama.cpp:masterfrom gg/refactor-unicodeggerganov/llama.cpp:gg/refactor-unicodeCopy head branch name to clipboardMar 11, 2024

+1,744-836

Commits

Commits on Mar 11, 2024

• llama : refactor unicode stuff

  Show description for 0458996
  ggerganov

  committed
  0458996

  Copy full SHA for 0458996

• unicode : names

  ggerganov

  committed
  9654d62

  Copy full SHA for 9654d62

• make : fix c++ compiler

  ggerganov

  committed
  9f3f7d8

  Copy full SHA for 9f3f7d8

• unicode : names

  ggerganov

  committed
  de0929a

  Copy full SHA for de0929a

• unicode : straighten tables

  ggerganov

  committed
  e607540

  Copy full SHA for e607540

• zig : fix build

  ggerganov

  committed
  be12d8b

  Copy full SHA for be12d8b

• unicode : put nfd normalization behind API

  Show description for 6568c62
  ggerganov

  committed
  6568c62

  Copy full SHA for 6568c62

• swift : fix build

  ggerganov

  committed
  4600538

  Copy full SHA for 4600538

• unicode : add BOM

  ggerganov

  committed
  58d5491

  Copy full SHA for 58d5491

• unicode : add <cstdint>

  Show description for af0621e
  ggerganov

  committed
  af0621e

  Copy full SHA for af0621e

• unicode : pass as cpts as const ref

  ggerganov

  committed
  3680bc2

  Copy full SHA for 3680bc2