Support for Llama.cpp

[chigkim]

Could we have support for Llama.cpp?
That will make the model more accessible to many popular tools like Ollama, LM Studio, Koboldcpp, text-generation-webui, etc.
Thank you so much!

[isr431]

Would love to see support added to Llama.cpp! This will make it way more accessible for people to use

[jinze1994]

Supporting llama.cpp is ongoing (it's a bit hard but we'll try again). Thus temporarily no ollama or lmstudio for now.

[coffepowered]

+1 for this, having support in llama.cpp would really help

[zcxo]

+1

[fredconex]

+1

[fredconex]

+1 Thanks for the efforts!

[wmx-github]

非常期待啊

[theaimer09]

插眼

[zhouxihong1]

+1

[grigio]

great model! I hope to see it in llama.cpp

[isriam]

+1

[PeterWang-dev]

PLEASE! Do NOT spam this issue. If you wanna express your support, just use stick to vote. Everytime you posting "+1" sends every subscribed ones an email!

[cloudyuyuyu]

any update？

[dr-ijaz]

+1

[verigle]

+1

[CiaranYoung]

so i wanna know it implement or not

[zsf513]

+1