Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add DB support to translate messages automatically with LLM model #4

Merged
merged 77 commits into from
Feb 19, 2024
Merged

Add DB support to translate messages automatically with LLM model #4

merged 77 commits into from
Feb 19, 2024

Conversation

verovaleros
Copy link
Member

Description

This PR allows the tool to interact with the DB and automatically translate messages using the LLM model and configuration.

Type of change

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

How Has This Been Tested?

  • Added tests for the core DB functions
  • Run manually in both manual and automatic mode to make sure works as expected.

Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings

@verovaleros
Add placeholder for db utils
ee9ae1d
@verovaleros
Add get_db_connection
9daeb30
@verovaleros
Unignore lib
e6d0c7c
@verovaleros
Add test db connection
ff94aab
@verovaleros
Add function to check channel exists in DB
c81a52b
@verovaleros
Set fake table to check channel_name
da8e09b
@verovaleros
Test the channel exist function when channel exists
5470e7d
@verovaleros
Test the channel exist function when channel does not exist
05a79ae
@verovaleros
Ignore long lines on test files
28b4246
@verovaleros
Add has_channel_messsages function
0937129 
False if there aren't any messages
True if there's at least one message
@verovaleros
Import new has channels function
b39ad9d
@verovaleros
Add more content to test DB
6a87211
@verovaleros
Update check_channel exists to check on new DB
504fc30
@verovaleros
Test for three conditions on has channel messages
0a52f62
@verovaleros
fixed docstring
39f0589
@verovaleros
Ignore test yaml file
563a58b
@verovaleros
Add schema for the translation DB tables
35869ef
@verovaleros
Add test to validate the sql schema we crated
0f420aa
@verovaleros
Optimise if/else on return
7729f0b
@verovaleros
Update name in dosctring
b1ce945
@verovaleros
Move logic to manual mode function
a43a8ee
@verovaleros
Add param to support more than one mode
48c58d1
@verovaleros
Move logic to manual mode function
8e51e7d
@verovaleros
Add argument to receive DB path
f08105e
@verovaleros
match mode case and run the manual mode
5494497
@verovaleros
Rename to conform snake_case style
30e64f1
@verovaleros
Changing default level of logging to ERROR only
0d5d6a2
@verovaleros
keeping long arg for DB input
979738f
@verovaleros
Add verbose/debug mode
ddefec4
@verovaleros
Add skeleton for sqlite auto mode
69ace1e
@verovaleros
Create tables from schema
eabf775
@verovaleros
Check if channel has messages
2f0e833
@verovaleros
Close connection on exit
e143709
@verovaleros
Insert translation parameters to table
c2b829c
@verovaleros
Modify schema to have unique translation parameters
ac439b3
@verovaleros
Update insert query to insert or ignore
6bf6840
@verovaleros
Retrieve the id by making a query instead of lastrowid
bba1e7c
@verovaleros
Update pytest to match the changes on DB
aa6292a
@verovaleros
Fix schema names
a2ea62b
@verovaleros
Add function to get all channel messages
8d385d5
@verovaleros
Add tests for get channel messages
d9553e8
@verovaleros
Check if translation exists for given message
c3164c4
@verovaleros
Modify tests to check exists_translation function
c837916
@verovaleros
Fix debugging messages text
54be08b
@verovaleros
Fix typo in variable
a5c51ce
@verovaleros
Fix typo in variable
51089fe
@verovaleros
Get all messages for channel name
40f3e1e
@verovaleros
Process messages to check if translation exists
a564c8b
@verovaleros
Update schema to add unique constraint
adbb971
@verovaleros
Add function to update message translation
e068803
@verovaleros
Separate OpenAI translation logic from mode of operation
5967253
@verovaleros
Add logic of translation
8251b4c
@verovaleros
Add comment to code
5ac6d30
@verovaleros
Implement max translation limit for each run
5581d98
@verovaleros
Add sample sqlite to test
001f574
@verovaleros verovaleros added the enhancement New feature or request label Feb 19, 2024
@verovaleros verovaleros added this to the v1.0.0 milestone Feb 19, 2024
@verovaleros verovaleros self-assigned this Feb 19, 2024
@verovaleros verovaleros merged commit 1774374 into main Feb 19, 2024
4 checks passed
@verovaleros verovaleros deleted the feat_database-support branch February 19, 2024 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@verovaleros verovaleros

Labels
enhancement New feature or request
Projects
None yet
Milestone
v1.0.0
Development

Successfully merging this pull request may close these issues.
1 participant
@verovaleros