Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: Host pre-aggregated LLM knowledge files #1355

Merged
merged 7 commits into from
Feb 16, 2025
Merged

Conversation

aklinker1
Copy link
Collaborator

@aklinker1 aklinker1 commented Jan 15, 2025

I'm working on getting a LLM trained on WXT's docs, and this is the first step. The input data is good enough to get good responses from the AI:

Demo question

See the discord thread for more info: https://discord.com/channels/1212416027611365476/1328125896636366892

Here's the package I created to host these files:

You can preview these files from this PR at: https://deploy-preview-1355--creative-fairy-df92c4.netlify.app/knowledge/index.json
Once merged, you can view the latest files at: https://wxt.dev/knowledge/index.json

@aklinker1 aklinker1 added the docs Improvements or additions to documentation label Jan 15, 2025
Copy link

netlify bot commented Jan 15, 2025

Deploy Preview for creative-fairy-df92c4 ready!

Name Link
🔨 Latest commit 1a4a518
🔍 Latest deploy log https://app.netlify.com/sites/creative-fairy-df92c4/deploys/67b2308eb0b8580008c2959a
😎 Deploy Preview https://deploy-preview-1355--creative-fairy-df92c4.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@aklinker1 aklinker1 marked this pull request as ready for review January 15, 2025 17:16
Copy link

pkg-pr-new bot commented Jan 15, 2025

Open in Stackblitz

@wxt-dev/auto-icons

npm i https://pkg.pr.new/@wxt-dev/auto-icons@1355

@wxt-dev/i18n

npm i https://pkg.pr.new/@wxt-dev/i18n@1355

@wxt-dev/module-solid

npm i https://pkg.pr.new/@wxt-dev/module-solid@1355

@wxt-dev/module-svelte

npm i https://pkg.pr.new/@wxt-dev/module-svelte@1355

@wxt-dev/module-react

npm i https://pkg.pr.new/@wxt-dev/module-react@1355

@wxt-dev/module-vue

npm i https://pkg.pr.new/@wxt-dev/module-vue@1355

@wxt-dev/storage

npm i https://pkg.pr.new/@wxt-dev/storage@1355

@wxt-dev/unocss

npm i https://pkg.pr.new/@wxt-dev/unocss@1355

wxt

npm i https://pkg.pr.new/wxt@1355

commit: 1a4a518

@aklinker1
Copy link
Collaborator Author

Not sure why checks are failing, and this doesn't really produce a good OpenAI assistant... so I'm closing it. If someone whats this published, LMK and I can sort out the issues.

@aklinker1 aklinker1 closed this Jan 20, 2025
@aklinker1
Copy link
Collaborator Author

aklinker1 commented Feb 16, 2025

Tested this again, but this time using Google's gemini-2-flash... and it's really good. RAG just sucks for this lol. Just putting the full docs in the prompt with 1M tokens did the trick.

@aklinker1 aklinker1 reopened this Feb 16, 2025
@aklinker1 aklinker1 requested a review from Timeraa as a code owner February 16, 2025 17:16
@Timeraa
Copy link
Contributor

Timeraa commented Feb 16, 2025

Can't test it but looks good

Copy link

codecov bot commented Feb 16, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 81.24%. Comparing base (80ca576) to head (1a4a518).
Report is 2 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1355      +/-   ##
==========================================
- Coverage   81.33%   81.24%   -0.10%     
==========================================
  Files         128      128              
  Lines        6296     6296              
  Branches     1075     1073       -2     
==========================================
- Hits         5121     5115       -6     
- Misses       1160     1166       +6     
  Partials       15       15              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@aklinker1 aklinker1 merged commit f80909d into main Feb 16, 2025
18 checks passed
@aklinker1 aklinker1 deleted the llm-knowledge-files branch February 16, 2025 20:03
Copy link

Thanks for helping make WXT better!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants