Code

merge from upstream#40

Code

Merged

l3utterfly merged 28 commits intolayla-buildl3utterfly/llama.cpp:layla-buildfrom masterl3utterfly/llama.cpp:masterCopy head branch name to clipboardOct 1, 2024

+1,827-514

Commits

Commits on Sep 26, 2024

• [SYCL] add missed dll file in package (ggerganov#9577)

  Show description for 95bc82f
  

  NeoZhangJianyu

  and

  arthw

  authored
  95bc82f

  Copy full SHA for 95bc82f

Commits on Sep 27, 2024

• cmake : add option for common library (ggerganov#9661)

  iboB

  authored
  44f59b4

  Copy full SHA for 44f59b4

• readme : update hot topics

  ggerganov

  authored
  b5de3b7

  Copy full SHA for b5de3b7

Commits on Sep 28, 2024

• Enable use to the rebar feature to upload buffers to the device. (ggerganov#9251)

  mtavenrath

  authored
  89f9944

  Copy full SHA for 89f9944

• ggml : add run-time detection of neon, i8mm and sve (ggerganov#9331)

  Show description for 6a0f779
  eddnjjn

  authored
  6a0f779

  Copy full SHA for 6a0f779

• readme : add tool (ggerganov#9655)

  akx

  authored
  43bcdd9

  Copy full SHA for 43bcdd9

• llama : add support for Chameleon (ggerganov#8543)

  Show description for 9a91311
  

  nopperl

  and

  compilade

  authored
  9a91311

  Copy full SHA for 9a91311

• vocab : refactor tokenizer to reduce init overhead (ggerganov#9449)

  Show description for 6102037
  

  kylo5aby

  and

  ggerganov

  authored
  6102037

  Copy full SHA for 6102037

• llama : add comment about thread-safety [no ci] (ggerganov#9449)

  ggerganov

  committed
  7398427

  Copy full SHA for 7398427

• test-backend-ops : use flops for some performance tests (ggerganov#9657)

  Show description for 1b2f992
  slaren

  authored
  1b2f992

  Copy full SHA for 1b2f992

• llama : add reranking support (ggerganov#9510)

  Show description for f4d2b88
  

  ggerganov

  and

  ngxson

  authored
  f4d2b88

  Copy full SHA for f4d2b88

Commits on Sep 29, 2024

• contrib : add Resources section (ggerganov#9675)

  ggerganov

  authored
  589b48d

  Copy full SHA for 589b48d

• py : add model class for Chameleon conversion (ggerganov#9683)

  nopperl

  authored
  f99d3f8

  Copy full SHA for f99d3f8

• common : ensure llama_batch size does not exceed max size (ggerganov#9668)

  Show description for faac0ba
  matiaslin

  authored
  faac0ba

  Copy full SHA for faac0ba

• ggml : fix GGML_MAX_N_THREADS + improve formatting (ggml/969)

  ggerganov

  committed
  6084bfb

  Copy full SHA for 6084bfb

• vulkan : argsort barriers must be under uniform control flow (ggml/951)

  Show description for 544f409
  

  smeso

  authored and

  ggerganov

  committed
  544f409

  Copy full SHA for 544f409

• vulkan : fix build for GGML_VULKAN_RUN_TESTS, add TFLOPS to log (ggml/961)

  

  jeffbolznv

  authored and

  ggerganov

  committed
  0de8b20

  Copy full SHA for 0de8b20

• vulkan : multithread pipeline creation (ggml/963)

  

  jeffbolznv

  authored and

  ggerganov

  committed
  641002f

  Copy full SHA for 641002f

• CUDA: remove bad assert (ggml/972)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  aaa4099

  Copy full SHA for aaa4099

• sync : ggml

  ggerganov

  committed
  d0b1d66

  Copy full SHA for d0b1d66

• ggml : define missing HWCAP flags (ggerganov#9684)

  Show description for c919d5d
  

  ggerganov

  and

  wtarreau

  authored
  c919d5d

  Copy full SHA for c919d5d

Commits on Sep 30, 2024

• console : utf-8 fix for windows stdin (ggerganov#9690)

  Show description for 8277a81
  

  hasaranga

  and

  ggerganov

  authored
  8277a81

  Copy full SHA for 8277a81

• flake.lock: Update (ggerganov#9680)

  Show description for ace4f4b
  

  ggerganov

  and

  github-actions[bot]

  authored
  ace4f4b

  Copy full SHA for ace4f4b

• py : update transfomers version (ggerganov#9694)

  Show description for 08a43d0
  Vaibhavs10

  authored
  08a43d0

  Copy full SHA for 08a43d0

• ci : reduce severity of unused Pyright ignore comments (ggerganov#9697)

  compilade

  authored
  511636d

  Copy full SHA for 511636d

• Fix Docker ROCM builds, use AMDGPU_TARGETS instead of GPU_TARGETS (ggerganov#9641)

  Show description for 6f1d9d7
  serhii-nakon

  authored
  6f1d9d7

  Copy full SHA for 6f1d9d7

Commits on Oct 1, 2024

• convert : refactor rope_freqs generation (ggerganov#9396)

  Show description for 1927378
  compilade

  authored
  1927378

  Copy full SHA for 1927378

• llama : print correct model type for Llama 3.2 1B and 3B

  ggerganov

  committed
  a90484c

  Copy full SHA for a90484c