From 76abeee884a205b2001a0412ed759fc322a23aa1 Mon Sep 17 00:00:00 2001 From: Samuel Walker Date: Fri, 15 Dec 2023 09:49:22 -0500 Subject: [PATCH] Update Makefile to support MOE In reference to https://github.com/ggerganov/llama.cpp/pull/4406 Need a newer version of llama.cpp to handle MoE models, such as Mixtral 8x7b Signed-off-by: Samuel Walker --- Makefile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/Makefile b/Makefile index c97f7fa621aa..d1f56e4afb2a 100644 --- a/Makefile +++ b/Makefile @@ -8,7 +8,7 @@ GOLLAMA_VERSION?=aeba71ee842819da681ea537e78846dc75949ac0 GOLLAMA_STABLE_VERSION?=50cee7712066d9e38306eccadcfbb44ea87df4b7 -CPPLLAMA_VERSION?=8a7b2fa528f130631a5f43648481596ab320ed5a +CPPLLAMA_VERSION?=799a1cb13b0b1b560ab0ceff485caed68faa8f1f # gpt4all version GPT4ALL_REPO?=https://github.com/nomic-ai/gpt4all