Code

merge from upstream#7

Code

Merged

l3utterfly merged 48 commits intolayla-buildl3utterfly/llama.cpp:layla-buildfrom masterl3utterfly/llama.cpp:masterCopy head branch name to clipboardApr 6, 2024

+42,678-19,435

Commits

Commits on Mar 28, 2024

• convert : refactor vocab selection logic (ggerganov#6355)

  cebtenzzre

  authored
  be55134

  Copy full SHA for be55134

• [SYCL] Revisited & updated SYCL build documentation (ggerganov#6141)

  Show description for 5106ef4
  OuadiElfarouki

  authored
  5106ef4

  Copy full SHA for 5106ef4

• readme : add notice for UI list

  ggerganov

  authored
  bfe7daf

  Copy full SHA for bfe7daf

Commits on Mar 29, 2024

• convert : allow conversion of Mistral HF models (ggerganov#6144)

  Show description for b75c381
  

  pcuenca

  and

  cebtenzzre

  authored
  b75c381

  Copy full SHA for b75c381

• llama : remove redundant reshape in build_kv_store (ggerganov#6369)

  Show description for 057400a
  

  danbev

  and

  ggerganov

  authored
  057400a

  Copy full SHA for 057400a

• cmake : add explicit metal version options (ggerganov#6370)

  Show description for 8093987
  

  mattjcly

  and

  ggerganov

  authored
  8093987

  Copy full SHA for 8093987

• readme : add project (ggerganov#6356)

  Show description for b910287
  zhouwg

  authored
  b910287

  Copy full SHA for b910287

• ci : fix BGE wget (ggerganov#6383)

  Show description for cfde806
  ggerganov

  authored
  cfde806

  Copy full SHA for cfde806

• [Model] Add support for xverse (ggerganov#6301)

  Show description for 0695747
  

  3 peopleauthored
  0695747

  Copy full SHA for 0695747

• sync : ggml (ggerganov#6351)

  Show description for d48ccf3
  

  ggerganov

  and

  slaren

  authored
  d48ccf3

  Copy full SHA for d48ccf3

• Vulkan k-quant mmq and ggml-backend offload functionality (ggerganov#6155)

  Show description for ba0c7c7
  0cc4m

  authored
  ba0c7c7

  Copy full SHA for ba0c7c7

• split: allow --split-max-size option (ggerganov#6343)

  Show description for f7fc5f6
  ngxson

  authored
  f7fc5f6

  Copy full SHA for f7fc5f6

• Fedora build update (ggerganov#6388)

  Show description for c342d07
  Man2Dev

  authored
  c342d07

  Copy full SHA for c342d07

Commits on Mar 30, 2024

• ci: bench: fix Resource not accessible by integration on PR event (ggerganov#6393)

  phymbert

  authored
  37e7854

  Copy full SHA for 37e7854

Commits on Mar 31, 2024

• readme : update hot topics

  ggerganov

  authored
  c50a82c

  Copy full SHA for c50a82c

Commits on Apr 1, 2024

• ci: server: verify deps are coherent with the commit (ggerganov#6409)

  Show description for 226e819
  phymbert

  authored
  226e819

  Copy full SHA for 226e819

• compare-llama-bench.py: fix long hexsha args (ggerganov#6424)

  JohannesGaessler

  authored
  33a5244

  Copy full SHA for 33a5244

• flake.lock: Update (ggerganov#6402)

  Show description for f87f7b8
  

  ggerganov

  and

  github-actions[bot]

  authored
  f87f7b8

  Copy full SHA for f87f7b8

Commits on Apr 3, 2024

• [SYCL] Disable iqx on windows as WA (ggerganov#6435)

  Show description for 5260486
  airMeng

  authored
  5260486

  Copy full SHA for 5260486

• ggml : mul_mat_id use the same tensor for all the experts (ggerganov#6387)

  Show description for 08a0c02
  

  slaren

  and

  ggerganov

  authored
  08a0c02

  Copy full SHA for 08a0c02

• readme : update hot topics

  ggerganov

  authored
  076b086

  Copy full SHA for 076b086

• Add OpenChat, Alpaca, Vicuna chat templates (ggerganov#6397)

  Show description for 1ff4d9f
  kaizau

  authored
  1ff4d9f

  Copy full SHA for 1ff4d9f

• Missing tokenizer.model error during gguf conversion (ggerganov#6443)

  Show description for db214fa
  

  overtunned

  and

  cebtenzzre

  authored
  db214fa

  Copy full SHA for db214fa

• security : create policy (ggerganov#6354)

  Show description for e69945d
  

  joycebrum

  and

  ggerganov

  authored
  e69945d

  Copy full SHA for e69945d

• readme : add feature-rich rust bindings (ggerganov#6465)

  francis2tm

  authored
  154d4ee

  Copy full SHA for 154d4ee

• server: add cURL support to server.Dockerfile (ggerganov#6461)

  elepedus

  authored
  5d4f12e

  Copy full SHA for 5d4f12e

• ci : update checkout, setup-python and upload-artifact to latest (ggerganov#6456)

  Show description for 9f62c01
  EwoutH

  authored
  9f62c01

  Copy full SHA for 9f62c01

• llama : add SEA-LION support (ggerganov#6448)

  Show description for bb43cf7
  

  3 peopleauthored
  bb43cf7

  Copy full SHA for bb43cf7

• server : handle exception on wrong type in request (ggerganov#6452)

  Show description for 60cdf40
  

  JH23X

  and

  Jonas Holzner

  authored
  60cdf40

  Copy full SHA for 60cdf40

• A few small fixes to server's README docs (ggerganov#6428)

  Show description for 5fb1574
  fat-tire

  authored
  5fb1574

  Copy full SHA for 5fb1574

Commits on Apr 4, 2024

• convert : fix for lint error complaining of bare except (ggerganov#6470)

  HanClinto

  authored
  72d73af

  Copy full SHA for 72d73af

• server : add option to disable KV offload (ggerganov#6468)

  jxy

  authored
  1a43c72

  Copy full SHA for 1a43c72

• server : remove obsolete --memory-f32 option

  ggerganov

  committed
  4399f13

  Copy full SHA for 4399f13

• examples : add GBNF validator program (ggerganov#5948)

  Show description for 9b84ae1
  HanClinto

  authored
  9b84ae1

  Copy full SHA for 9b84ae1

• common: remove duplicate check for curl (ggerganov#6471)

  Show description for 4bcd6b9
  danbev

  authored
  4bcd6b9

  Copy full SHA for 4bcd6b9

• ci: bench: add more ftype, fix triggers and bot comment (ggerganov#6466)

  Show description for 7a2c926
  phymbert

  authored
  7a2c926

  Copy full SHA for 7a2c926

• Correct README link (ggerganov#6458)

  Show description for a74401f
  limitedAtonement

  authored
  a74401f

  Copy full SHA for a74401f

• ci: bench fix concurrency for workflow trigger dispatch with sha1 (ggerganov#6478)

  phymbert

  authored
  8120efe

  Copy full SHA for 8120efe

• server: allow penalizing repetition of newlines on server webpage (ggerganov#6431)

  sha224

  authored
  2e66913

  Copy full SHA for 2e66913

• build CI: Name artifacts (ggerganov#6482)

  Show description for c666ba2
  EwoutH

  authored
  c666ba2

  Copy full SHA for c666ba2

• ci: exempt master branch workflows from getting cancelled (ggerganov#6486)

  Show description for 7dda1b7
  mscheong01

  authored
  7dda1b7

  Copy full SHA for 7dda1b7

• server: add cURL support to server Dockerfiles (ggerganov#6474)

  Show description for 0a1d889
  

  elepedus

  and

  ggerganov

  authored
  0a1d889

  Copy full SHA for 0a1d889

• readme : fix typo (ggerganov#6481)

  junnjiee

  authored
  b660a57

  Copy full SHA for b660a57

• readme : add Dot to UI list (ggerganov#6487)

  alexpinel

  authored
  a307375

  Copy full SHA for a307375

Commits on Apr 5, 2024

• [SYCL] Fixed minor bug when enabling FP16 for non intel targets (ggerganov#6464)

  Show description for 1b496a7
  

  OuadiElfarouki

  and

  AidanBeltonS

  authored
  1b496a7

  Copy full SHA for 1b496a7

• bench : make n_batch and n_ubatch configurable in Batched bench (ggerganov#6500)

  Show description for 87e21bb
  Sunt-ing

  authored
  87e21bb

  Copy full SHA for 87e21bb

• readme : update UI list (ggerganov#6503)

  Show description for d0f5dee
  

  hugo53

  and

  slaren

  authored
  d0f5dee

  Copy full SHA for d0f5dee

• gguf.py : add licence and version to gguf writer (ggerganov#6504)

  mofosyne

  authored
  a8bd14d

  Copy full SHA for a8bd14d