Removed Chats from Media DB (BREAKING CHANGE - moved to RAG QA db), Added mindmap viewing, token counts in convos, anki flashcard validation #409
Conversation
Wow. I thought the prior claude was getting worse. This is just a shitpile.
Save + Update + Load works in RAG / 'normal' / Stacked chat UIs Review of Conversations occurs in the Rag Chat/Search Tab Workflows needs to be updated as well
|
Won't merge until I have a migration script to make it easy for people who have chats they want to save. I recognize its a SQLite DB and one could just perform raw queries to extract the data, I want to make it as easy as possible since not all users are that technical. |
Backups not properly done yet, need sanity checks to prevent the wrong DB being imported/overwriting the current one. Ditto for showing available backups.
App_Function_Libraries/Gradio_UI/Backup_RAG_Notes_Character_Chat_tab.py
Dismissed
Show dismissed
Hide dismissed
…op level `View DB Items` tab Is now `Search/View DB Items`.
Keyword tabs WIP
|
Need to validate the export/migration script works, besides that this should all be working. Need to test it/confirm it works, but once I do, new features! |
…S - Merge pull request #409 from rmusser01/dev ALL PRIOR VERSIONS ARE BROKEN BY THIS MERGE. THIS VERSION INTRODUCES A NEW config.txt FILE WHICH WILL CAUSE BREAKING WHEN USING ANY LLM API CALLS. Docs, TTS, answer streaming, web search and perplexity clone Updates: More Docs (no user guides yet 👎 , but we got some feature documentation! 👍 ) Foundation for TTS, setup a basic pipeline and have the ability/plan to add more TTS APIs/Engines Have support for streaming of answers in chat in all except the 4-way chat and the One prompt-mutiple, API chat. Added foundations + actual feature of Web Search, can now do web search + sub searches to answer a query/do research on a topic. UI is a (even more of a temporary) placeholder for now, not too happy with it. But the underlying pipeline is pretty nice, can do a single -> sub/split query through your choice of search provider (Bing, DDG, Google, Brave, SearX, Kagi) and then have the results evaluated for relevancy, collected via page scraping and then summarized for final analysis. Lots of areas for improvement.
Split chats from the Media DB so that chats about media items are now stored in the RAG_QA db.
This allows the media DB to solely contain media items/info about them while the RAG_QA db will store all non-rp chats.
This furthers the idea of isolation between all components for re-usability and plug-n-play.
Added Mindmap viewing in Gradio from PlantUML specification. Generate a spec, copy/paste it in, and you got a mindmap.
Added token counts to conversations, rough approximation (not actually tokenizing) to get an idea of how long your convo is.
Added an Anki flashcard validation(working)/viewing(broken) functionality so that you can validate(?) your deck is good(?)
Plan is to look at implementing generation with genanki and LLMs so that you can be guided through/ask the LLM to help generate a structured output to be able to create anki flashcards that are exportable/reviewable.