Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

speed up scan initialization #9086

Merged

Conversation

ivanmorozov333
Copy link
Collaborator

  • Performance improvement

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 12:33:06 UTC Pre-commit check linux-x86_64-release-clang14 for c1f3876 has started.
2024-09-11 12:33:34 UTC Artifacts will be uploaded here
2024-09-11 12:36:19 UTC ya make is running...
2024-09-11 12:40:16 UTC Check cancelled

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 12:37:05 UTC Pre-commit check linux-x86_64-release-asan for c1f3876 has started.
2024-09-11 12:37:13 UTC Artifacts will be uploaded here
2024-09-11 12:39:59 UTC ya make is running...
2024-09-11 12:40:12 UTC Check cancelled

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 12:37:05 UTC Pre-commit check linux-x86_64-relwithdebinfo for c1f3876 has started.
2024-09-11 12:37:16 UTC Artifacts will be uploaded here
2024-09-11 12:40:00 UTC ya make is running...
2024-09-11 12:40:12 UTC Check cancelled

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 12:53:43 UTC Pre-commit check linux-x86_64-release-asan for 52261d1 has started.
2024-09-11 12:54:27 UTC Artifacts will be uploaded here
2024-09-11 12:57:44 UTC ya make is running...
🔴 2024-09-11 13:05:12 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 13:01:05 UTC Pre-commit check linux-x86_64-relwithdebinfo for 52261d1 has started.
2024-09-11 13:01:21 UTC Artifacts will be uploaded here
2024-09-11 13:04:11 UTC ya make is running...
🔴 2024-09-11 13:11:01 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 13:06:18 UTC Pre-commit check linux-x86_64-release-clang14 for 52261d1 has started.
2024-09-11 13:08:59 UTC Artifacts will be uploaded here
2024-09-11 13:12:20 UTC ya make is running...
🔴 2024-09-11 13:15:55 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 14:28:41 UTC Pre-commit check linux-x86_64-release-clang14 for c9480eb has started.
2024-09-11 14:28:50 UTC Artifacts will be uploaded here
2024-09-11 14:31:41 UTC ya make is running...
🟢 2024-09-11 15:01:27 UTC Build successful.

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 14:29:18 UTC Pre-commit check linux-x86_64-relwithdebinfo for c9480eb has started.
2024-09-11 14:29:28 UTC Artifacts will be uploaded here
2024-09-11 14:32:16 UTC ya make is running...
🟡 2024-09-11 15:54:14 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14757 13283 0 14 1367 93

2024-09-11 15:55:30 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-09-11 16:05:55 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
111 (only retried tests) 16 0 9 0 86

2024-09-11 16:06:03 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-09-11 16:13:41 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
100 (only retried tests) 6 0 9 0 85

🟢 2024-09-11 16:13:49 UTC Build successful.
🟢 2024-09-11 16:14:35 UTC ydbd size 8.4 GiB changed* by -63.9 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 6e1d0a0 merge: c9480eb diff diff %
ydbd size 9 029 241 664 Bytes 9 029 176 272 Bytes -63.9 KiB -0.001%
ydbd stripped size 487 837 928 Bytes 487 850 664 Bytes +12.4 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 14:32:50 UTC Pre-commit check linux-x86_64-release-asan for c9480eb has started.
2024-09-11 14:33:06 UTC Artifacts will be uploaded here
2024-09-11 14:35:51 UTC ya make is running...
🔴 2024-09-11 16:31:51 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10313 10144 0 31 38 100

🟢 2024-09-11 16:32:55 UTC Build successful.
🟢 2024-09-11 16:33:28 UTC ydbd size 5.6 GiB changed* by +34.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: c513c4e merge: c9480eb diff diff %
ydbd size 6 040 965 696 Bytes 6 041 001 384 Bytes +34.9 KiB +0.001%
ydbd stripped size 1 511 656 656 Bytes 1 511 677 328 Bytes +20.2 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 16:38:05 UTC Pre-commit check linux-x86_64-relwithdebinfo for e85de87 has started.
2024-09-11 16:39:05 UTC Artifacts will be uploaded here
2024-09-11 16:42:21 UTC ya make is running...
🟡 2024-09-11 17:41:56 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14757 13112 0 17 1365 263

2024-09-11 17:43:12 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-09-11 17:53:06 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
288 (only retried tests) 194 0 1 8 85

2024-09-11 17:53:15 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-09-11 18:01:48 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
91 (only retried tests) 5 0 1 0 85

🟢 2024-09-11 18:01:55 UTC Build successful.
🟢 2024-09-11 18:02:32 UTC ydbd size 8.4 GiB changed* by -180.2 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 5f125c0 merge: e85de87 diff diff %
ydbd size 9 029 719 008 Bytes 9 029 534 448 Bytes -180.2 KiB -0.002%
ydbd stripped size 487 854 440 Bytes 487 869 032 Bytes +14.2 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 16:38:08 UTC Pre-commit check linux-x86_64-release-clang14 for e85de87 has started.
2024-09-11 16:38:17 UTC Artifacts will be uploaded here
2024-09-11 16:40:59 UTC ya make is running...
🟢 2024-09-11 16:49:31 UTC Build successful.

Copy link

github-actions bot commented Sep 11, 2024

2024-09-11 16:38:41 UTC Pre-commit check linux-x86_64-release-asan for e85de87 has started.
2024-09-11 16:38:50 UTC Artifacts will be uploaded here
2024-09-11 16:41:34 UTC ya make is running...
🔴 2024-09-11 18:29:44 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10327 9948 0 54 284 41

🟢 2024-09-11 18:30:38 UTC Build successful.
🟢 2024-09-11 18:31:11 UTC ydbd size 5.6 GiB changed* by +32.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 5f125c0 merge: e85de87 diff diff %
ydbd size 6 041 294 496 Bytes 6 041 328 176 Bytes +32.9 KiB +0.001%
ydbd stripped size 1 511 717 968 Bytes 1 511 738 064 Bytes +19.6 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 05:44:04 UTC Pre-commit check linux-x86_64-release-asan for 1e5e3f8 has started.
2024-09-12 05:44:08 UTC Artifacts will be uploaded here
2024-09-12 05:46:55 UTC ya make is running...
🔴 2024-09-12 07:46:02 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10341 10093 0 75 66 107

🟢 2024-09-12 07:46:58 UTC Build successful.
🟢 2024-09-12 07:47:34 UTC ydbd size 5.6 GiB changed* by +28.9 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 9a9b2e6 merge: 1e5e3f8 diff diff %
ydbd size 6 044 822 040 Bytes 6 044 851 648 Bytes +28.9 KiB +0.000%
ydbd stripped size 1 512 777 904 Bytes 1 512 793 904 Bytes +15.6 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 05:45:29 UTC Pre-commit check linux-x86_64-release-clang14 for 1e5e3f8 has started.
2024-09-12 05:45:39 UTC Artifacts will be uploaded here
2024-09-12 05:48:34 UTC ya make is running...

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 05:45:52 UTC Pre-commit check linux-x86_64-relwithdebinfo for 1e5e3f8 has started.
2024-09-12 05:46:02 UTC Artifacts will be uploaded here
2024-09-12 05:48:57 UTC ya make is running...
🟡 2024-09-12 06:51:53 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14760 13131 0 2 1597 30

2024-09-12 06:53:10 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-12 07:03:26 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
268 (only retried tests) 175 0 0 7 86

🟢 2024-09-12 07:03:34 UTC Build successful.
🟢 2024-09-12 07:04:18 UTC ydbd size 8.4 GiB changed* by -184.2 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 9a9b2e6 merge: 1e5e3f8 diff diff %
ydbd size 9 034 978 992 Bytes 9 034 790 400 Bytes -184.2 KiB -0.002%
ydbd stripped size 488 200 168 Bytes 488 210 728 Bytes +10.3 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@ivanmorozov333 ivanmorozov333 force-pushed the speed_up_scan_initialization branch from 3d6f060 to 08ef708 Compare September 12, 2024 09:39
Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 09:42:53 UTC Pre-commit check linux-x86_64-release-clang14 for 674906e has started.
2024-09-12 09:43:02 UTC Artifacts will be uploaded here
2024-09-12 09:45:51 UTC ya make is running...
🔴 2024-09-12 09:51:46 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 09:42:54 UTC Pre-commit check linux-x86_64-relwithdebinfo for 674906e has started.
2024-09-12 09:43:04 UTC Artifacts will be uploaded here
2024-09-12 09:45:43 UTC ya make is running...
🔴 2024-09-12 09:51:47 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 09:43:00 UTC Pre-commit check linux-x86_64-release-asan for 674906e has started.
2024-09-12 09:43:10 UTC Artifacts will be uploaded here
2024-09-12 09:45:53 UTC ya make is running...
🔴 2024-09-12 09:50:48 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 09:59:18 UTC Pre-commit check linux-x86_64-release-clang14 for 590fd3e has started.
2024-09-12 09:59:28 UTC Artifacts will be uploaded here
2024-09-12 10:02:15 UTC ya make is running...
🟢 2024-09-12 10:09:42 UTC Build successful.

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 09:59:49 UTC Pre-commit check linux-x86_64-relwithdebinfo for 590fd3e has started.
2024-09-12 09:59:53 UTC Artifacts will be uploaded here
2024-09-12 10:02:34 UTC ya make is running...
🟡 2024-09-12 11:05:41 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14763 13128 0 6 1598 31

2024-09-12 11:06:59 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-12 11:17:00 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
273 (only retried tests) 180 0 0 7 86

🟢 2024-09-12 11:17:08 UTC Build successful.
🟢 2024-09-12 11:17:42 UTC ydbd size 8.4 GiB changed* by -219.3 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 4d137ad merge: 590fd3e diff diff %
ydbd size 9 035 109 760 Bytes 9 034 885 232 Bytes -219.3 KiB -0.002%
ydbd stripped size 488 206 024 Bytes 488 213 640 Bytes +7.4 KiB +0.002%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 12, 2024

2024-09-12 10:01:36 UTC Pre-commit check linux-x86_64-release-asan for 590fd3e has started.
2024-09-12 10:01:47 UTC Artifacts will be uploaded here
2024-09-12 10:04:31 UTC ya make is running...
🔴 2024-09-12 11:47:04 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10316 10148 0 25 43 100

🟢 2024-09-12 11:47:58 UTC Build successful.
🟢 2024-09-12 11:48:35 UTC ydbd size 5.6 GiB changed* by -25.9 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 4d137ad merge: 590fd3e diff diff %
ydbd size 6 044 978 568 Bytes 6 044 952 096 Bytes -25.9 KiB -0.000%
ydbd stripped size 1 512 804 336 Bytes 1 512 813 552 Bytes +9.0 KiB +0.001%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@ivanmorozov333 ivanmorozov333 marked this pull request as ready for review September 12, 2024 13:37
@ivanmorozov333 ivanmorozov333 requested a review from a team as a code owner September 12, 2024 13:37
@ivanmorozov333 ivanmorozov333 merged commit 8585364 into ydb-platform:main Sep 12, 2024
10 of 12 checks passed
@ivanmorozov333 ivanmorozov333 deleted the speed_up_scan_initialization branch September 12, 2024 13:37
zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Sep 15, 2024
@shnikd shnikd mentioned this pull request Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants