Instead of erroring on context length exceeded after 3 attempts, ask the user what to do #1096
Labels
enhancement
New feature or request
Comments
jasonkneen
added a commit
to jasonkneen/maverick
that referenced
this issue
Feb 6, 2025
Fixes block#1096 Add user prompt for further truncation or exit when context length exceeds limits. * Modify `crates/goose-cli/src/prompt.rs` to add `TruncateFurther` variant to `InputType` enum and `Input` struct, and add `ask_user_for_truncation` function to `Prompt` trait. * Modify `crates/goose/src/agents/extension.rs` to update `ContextLimit` error to include user prompt. * Add test cases in `crates/goose/tests/providers.rs` for user prompt on context length exceeded, including scenarios for further truncation and exit. --- For more details, open the [Copilot Workspace session](https://copilot-workspace.githubnext.com/block/goose/issues/1096?shareId=XXXX-XXXX-XXXX-XXXX).
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Currently, we try to attempt truncation 3 times with 90%, 80%, 70% msgs - then fail.
Instead, we can ask the user whether we should attempt futher truncation OR to exit so that user can start a fresh session if they want
The text was updated successfully, but these errors were encountered: