Skip to content

Latest commit

 

History

History
28 lines (21 loc) · 683 Bytes

README.md

File metadata and controls

28 lines (21 loc) · 683 Bytes

llama.cpp server Playground🦙

A very simple one-file playground inpired on Open-AI playground for llama.cpp http server usage. More information about server.cpp: https://github.com/ggerganov/llama.cpp/tree/master/examples/server

Screenshot

Image

Configure proxy address

Edit the vite.config.ts and change the "target" value for the llama.cpp server ip.

How to run

Install dependences

npm install

Launch server

npm run dev

Compiles and minifies for production

npm run build

It will generate a simple html that can be execute with the browser without using a server (except the llama serve.cpp runing).