feat: Implement streaming for Functionary v2 + Bug fixes (#1419) · abetlen/llama-cpp-python@1f56c64 · GitHub

Commit

feat: Implement streaming for Functionary v2 + Bug fixes (#1419)

Browse files

* set up streaming for v2

* assert v2 streaming, fix tool_call vs function_call

* fix streaming with tool_choice/function_call

* make functions return 1 function call only when 'auto'

* fix

---------

Co-authored-by: Andrei <abetlen@gmail.com>

Loading branch information

jeffrey-fong and abetlen authored May 4, 2024

1 parent f9b7221 commit 1f56c64