Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
common: ensure token addition to batch does not exceed llama_batch size
A crash was observed when the number of tokens added to a batch exceeds llama_batch size. An assertion in llama_batch_add was added to protect against llama_batch size overflow.
- Loading branch information