Leo sometimes gives incomplete answers/stops responding

[Brave-Matt]

Description

Some users — including @AlanBreck — have reported that Leo sometimes simply stops mid response. At least two of these instances are using the Claude model (will update when the third confirms that model is in use, along with other info). This behavior occurs when summarizing pages and during standard responses:

Reproduces how often:

Consistently

Brave version (brave://version info)

Version/Channel Information:

Nightly at least

Miscellaneous Information:

User reports:
https://community.brave.com/t/leo-only-generates-partial-message/516363
https://community.brave.com/t/claude-cuts-off-mid-sentence/515934/10

[Brave-Matt]

One of the users reporting this has the following setup:

Brave Version: 1.62.52 Chromium 119.0.6045.134 (Official Build) nightly (64bit)
Language Model: Llama2 13b

Windows 11 Enterprise|
Version 22H2
OS build|22621.2428
Experience Windows Feature Experience Pack 1000.22674.1000.0

[Brave-Matt]

The other user seeing this (link in OP) has:

Version 1.60.114 Chromium: 119.0.6045.124 (Official Build) (64-bit)
On Devuan Daedalus, which is essentially Debian Bookworm without SystemD.

[ksoutherland]

One of the users reporting this has the following setup:

Brave Version: 1.62.52 Chromium 119.0.6045.134 (Official Build) nightly (64bit)
Language Model: Llama2 13b
Windows 11 Enterprise|
Version 22H2
OS build|22621.2428
Experience Windows Feature Experience Pack 1000.22674.1000.0

I'd like to add where this was my post in the community support that I downloaded the stable version of the browser as well and am still getting the same issues with the stable version of the browser and no matter the question or site I'm on all responses are from Leo are being cut short. So with the stable browser my setup looks like this:
Brave Version: 1.60.114 Chromium 119.0.6045.124 (Official Build) (64bit)
Language Model: Llama2 13b

Windows 11 Enterprise
Version 22H2
OS build 22621.2428
Experience Windows Feature Experience Pack 1000.22674.1000.0

[kjozwiak]

The above requires 1.60.121 or higher for 1.60.x verification 👍 @brave/qa-team you can find examples/template of the STR/Cases used via brave/brave-core#21018 (comment) & brave/brave-core#21018 (comment).

[GeetaSarvadnya]

Verification PASSED on

Brave | 1.60.124 Chromium: 119.0.6045.163 (Official Build) (64-bit)
-- | --
Revision | 803c85554783c998a840f4b211c94236409a9928
OS | Windows 10 Version 22H2 (Build 19045.3693)

Basically used the STR/guidance from brave/brave-core#21018 (comment) and went through the following:

• ensured that you get a Premium prompt/modal within the sidebar panel when attempting to pick a premium model
• ensured that you can run through the signup flow and retrieve the needed tokens for users with a subscription

Example	Example

llama-2-13b-chat

• ensured that you can ask the llama a question and get an answer that isn't cut off
• ensured that you can summarize a page/ask follow up questions without the answers being cut off

Example	Example	Example	Example	Example

llama-2-70b-chat

• ensured that you can ask the llama a question and get an answer that isn't cut off
• ensured that you can summarize a page/ask follow up questions without the answers being cut off

Example	Example	Example	Example	Example

claude-instant-v1

• ensured that you can ask the claude a question and get an answer that isn't cut off
• ensured that you can summarize a page/ask follow up questions without the answers being cut off

Example	Example	Example	Example	Example

[Tritonio]

I am still definitely getting this issue in Version 1.60.125 Chromium: 119.0.6045.199 (Official Build) (64-bit) with premium Llama 70b.