rpc : backend refactoring (#9912) · drollings/llama.cpp@11c29ee · GitHub

Commit

rpc : backend refactoring (ggerganov#9912)

Browse files

* rpc : refactor backend

Use structs for RPC request/response messages

* rpc : refactor server

Loading branch information

rgerganov authored and drollings committed Oct 18, 2024

1 parent be19a9e commit 11c29ee