Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement HIST and database #27

Merged
merged 34 commits into from
May 17, 2023
Merged

Implement HIST and database #27

merged 34 commits into from
May 17, 2023

Conversation

Uggah
Copy link
Contributor

@Uggah Uggah commented May 17, 2023

Messages published on the pubsub broker are saved on a database and can be retrieved using the HIST request.
They can also be organized in the request using parameters (from, until, max_density).
To store the messages, we use a sqlite database.

Closes #9

Uggah added 30 commits May 11, 2023 16:42
@Uggah
Fix log levels not being parsed correctly
d8c992e
@Uggah
Fix clock running twice, add clock configuration, decrease unnecessar…
f11734b 
…y logging, fix issues with context singleton, fix error handling in root.go
@Uggah
Add database and history functionality
307080d 
Database entries are compressed to decrease file size.
@Uggah
Add configuration of database file
3eb3bf5
@Uggah
Fix tests
7b78e93
@Uggah
Refactor cpu package
4f7df76
@Uggah
Fix Makefile
fff6b84
@Uggah
Refactor websocket switch-case
44173a5
@Uggah
Implement purging old entries and vacuuming database
ae5c35b
@Uggah
Fix unknown time unit "d" in storage_time
584455b
@Uggah
Close sql statements and queries
208fcf2
@Uggah
Add tests for database package
89840ff
@Uggah
Fix TestMain in pubsub package
6b7c90f
@Uggah
Refactor websocket protocol implementation
2bc54d6
@Uggah
Fix missing logger
3dc542d
@Uggah
Fix nil pointers on wrong credentials format
04fe9c7
@Uggah
Implement method for getting history entries by start and end time fr…
e18bba9 
…om database
@Uggah
Implement getting history data with defining beginning and end date
8761406
@Uggah
Implement thinning of history
86707b9
@Uggah
Fix database query excluding from and until and including only timest…
a5f33e7 
…amps in between
@Uggah
Fix logging in reader.go
6a377f5
@Uggah
Fix unset maxDensity in a HIST request not being handled properly
3fa70a5
@Uggah
Add tests for websockets
cdd6651
@Uggah
Fix TestHIST
2a63d1d
@Uggah
Fix data thinning when reference is equal to timestamp
cb8f11a
@Uggah
Use a reference time in test to fix edge cases
ce9773a
@Uggah
Add test for max_density
4bbeb08
@Uggah
Fix IDE warnings on potentially dangerous sql statement in tests for …
ce8a5df 
…clearing table
@Uggah
Extend Makefile with coverage tests
d118480
@Uggah
Extend test for thinData
39d9a3f
@Uggah Uggah added the Feature New feature or request label May 17, 2023
@Uggah Uggah added this to the MVP - Minimum viable product milestone May 17, 2023
@Uggah Uggah requested a review from Joystick01 May 17, 2023 13:28
@Uggah Uggah self-assigned this May 17, 2023
Joystick01
Joystick01 approved these changes May 17, 2023
View reviewed changes
Copy link
Contributor

@Joystick01 Joystick01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Viel rot,
Noch mehr Grün,
leider kein Blau oder Orange.

LGTM ;)

@Uggah Uggah merged commit 3e6b5ed into development May 17, 2023
@Uggah Uggah deleted the database branch May 17, 2023 13:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Joystick01 Joystick01 Joystick01 approved these changes

Assignees

@Uggah Uggah

Labels
Feature New feature or request
Projects
None yet
Milestone
MVP - Minimum viable product
Development

Successfully merging this pull request may close these issues.
2 participants
@Uggah @Joystick01