Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unify indexation (for committed data) and compaction #6909

Conversation

ivanmorozov333
Copy link
Collaborator

  • Improvement
  • Performance improvement

Copy link

github-actions bot commented Jul 21, 2024

2024-07-21 14:37:21 UTC Pre-commit check for e7fa04e has started.
2024-07-21 14:40:28 UTC Build+Tests linux-x86_64-release-asan is running...
🔴 2024-07-21 15:52:31 UTC Test run completed, no test results found for commit 831f41c.
2024-07-21 15:52:57 UTC Check cancelled

Copy link

github-actions bot commented Jul 21, 2024

2024-07-21 14:37:34 UTC Pre-commit check for e7fa04e has started.
2024-07-21 14:40:37 UTC Build+Tests linux-x86_64-release-clang14 is running...
🟢 2024-07-21 15:16:12 UTC Build successful.

Copy link

github-actions bot commented Jul 21, 2024

2024-07-21 14:37:42 UTC Pre-commit check for e7fa04e has started.
2024-07-21 14:40:39 UTC Build+Tests linux-x86_64-relwithdebinfo is running...
🔴 2024-07-21 15:52:30 UTC Test run completed, no test results found for commit 831f41c.
2024-07-21 15:52:48 UTC Check cancelled

Copy link

github-actions bot commented Jul 21, 2024

2024-07-21 15:57:39 UTC Pre-commit check for b8fbb10 has started.
2024-07-21 16:00:43 UTC Build+Tests linux-x86_64-release-clang14 is running...
🟢 2024-07-21 16:13:49 UTC Build successful.

Copy link

github-actions bot commented Jul 21, 2024

2024-07-21 15:59:48 UTC Pre-commit check for b8fbb10 has started.
2024-07-21 16:02:46 UTC Build+Tests linux-x86_64-relwithdebinfo is running...
🟢 2024-07-21 17:56:53 UTC Build successful.
🔴 2024-07-21 18:01:18 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39604 34353 0 7 5225 19

🟡 2024-07-21 18:02:00 UTC ydbd size 8.1 GiB changed* by +777.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 1c15550 merge: b8fbb10 diff diff %
ydbd size 8 656 109 112 Bytes 8 656 904 840 Bytes +777.1 KiB +0.009%
ydbd stripped size 471 115 872 Bytes 471 064 288 Bytes -50.4 KiB -0.011%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 21, 2024

2024-07-21 16:00:21 UTC Pre-commit check for b8fbb10 has started.
2024-07-21 16:03:19 UTC Build+Tests linux-x86_64-release-asan is running...
🟢 2024-07-21 18:16:23 UTC Build successful.
🔴 2024-07-21 18:18:22 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11056 10460 0 97 325 174

🟢 2024-07-21 18:19:07 UTC ydbd size 5.2 GiB changed* by -447.3 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 5e95651 merge: b8fbb10 diff diff %
ydbd size 5 556 133 632 Bytes 5 555 675 560 Bytes -447.3 KiB -0.008%
ydbd stripped size 1 197 007 984 Bytes 1 196 821 328 Bytes -182.3 KiB -0.016%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 22, 2024

2024-07-22 06:16:08 UTC Pre-commit check for e376ab9 has started.
2024-07-22 06:19:19 UTC Build+Tests linux-x86_64-release-clang14 is running...
🟢 2024-07-22 06:31:40 UTC Build successful.

Copy link

github-actions bot commented Jul 22, 2024

2024-07-22 06:16:30 UTC Pre-commit check for e376ab9 has started.
2024-07-22 06:19:30 UTC Build+Tests linux-x86_64-release-asan is running...
🟢 2024-07-22 08:33:22 UTC Build successful.
🔴 2024-07-22 08:35:39 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11058 10471 0 91 324 172

🟢 2024-07-22 08:36:28 UTC ydbd size 5.2 GiB changed* by -402.4 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 5e95651 merge: e376ab9 diff diff %
ydbd size 5 556 133 632 Bytes 5 555 721 576 Bytes -402.4 KiB -0.007%
ydbd stripped size 1 197 007 984 Bytes 1 196 827 600 Bytes -176.2 KiB -0.015%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jul 22, 2024

2024-07-22 06:16:43 UTC Pre-commit check for e376ab9 has started.
2024-07-22 06:19:51 UTC Build+Tests linux-x86_64-relwithdebinfo is running...
🟢 2024-07-22 08:22:32 UTC Build successful.
🔴 2024-07-22 08:26:56 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39601 34352 0 4 5226 19

🟡 2024-07-22 08:27:42 UTC ydbd size 8.1 GiB changed* by +768.5 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 1c15550 merge: e376ab9 diff diff %
ydbd size 8 656 109 112 Bytes 8 656 896 056 Bytes +768.5 KiB +0.009%
ydbd stripped size 471 115 872 Bytes 471 072 736 Bytes -42.1 KiB -0.009%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@ivanmorozov333 ivanmorozov333 merged commit 51ddf40 into ydb-platform:main Jul 22, 2024
8 of 12 checks passed
@ivanmorozov333 ivanmorozov333 deleted the indexation_and_compaction_unification branch July 22, 2024 08:46
@zverevgeny zverevgeny linked an issue Jul 30, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Effective writes for sparse data
2 participants