Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: read web content #90

Merged
merged 4 commits into from
Apr 3, 2024
Merged

feat: read web content #90

merged 4 commits into from
Apr 3, 2024

Conversation

lynchee-owo
Copy link
Contributor

resolve #88

@lynchee-owo lynchee-owo requested a review from mondaychen as a code owner April 2, 2024 21:04
@lynchee-owo lynchee-owo self-assigned this Apr 2, 2024
@lynchee-owo
Copy link
Contributor Author

lynchee-owo commented Apr 3, 2024

when voice mode turned on

Screenshot 2024-04-03 at 12 42 21 PM

when voice mode turned off

Screenshot 2024-04-03 at 12 34 24 PM

when voice mode turned on and ask to describe website

Screenshot 2024-04-03 at 12 43 29 PM

when voice mode turned off and ask to describe website

Screenshot 2024-04-03 at 12 48 28 PM

Copy link
Contributor

@mondaychen mondaychen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

overall looks good! two small things:

@@ -30,8 +35,27 @@ This is an example of expected response from you:
}
}

Your response must always be in JSON format and must include string "thought" and object "action", which contains the string "name" of tool of choice, and necessary arguments ("args") if required by the tool.
{
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

when voiceMode is false, maybe add the content in thought instead?

if (voiceMode && "thought" in query.action) {
voiceControl.speak(query.action.thought, onError);
if (voiceMode && "speak" in query.action && query.action.speak) {
voiceControl.speak(query.action.speak, onError);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fallback to thought if speak does not exist?

@lynchee-owo
Copy link
Contributor Author

with voice mode on

Screenshot 2024-04-03 at 2 45 26 PM

with voice mode off

Screenshot 2024-04-03 at 2 44 27 PM

@lynchee-owo lynchee-owo merged commit fce4379 into main Apr 3, 2024
3 checks passed
@mondaychen mondaychen deleted the lynchee/speak branch May 23, 2024 14:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Advance Voice Support
2 participants