scan optimization for filter applying in case simple chunks #12476

ivanmorozov333 · 2024-12-10T16:54:00Z

Improvement
Performance improvement

github-actions · 2024-12-10T17:03:15Z

⚪ 2024-12-10 17:03:14 UTC Pre-commit check linux-x86_64-relwithdebinfo for f63e9e3 has started.
⚪ 2024-12-10 17:03:26 UTC Artifacts will be uploaded here
⚪ 2024-12-10 17:06:27 UTC ya make is running...
⚫ 2024-12-10 17:44:32 UTC Check cancelled

github-actions · 2024-12-10T17:05:09Z

⚪ 2024-12-10 17:05:08 UTC Pre-commit check linux-x86_64-release-asan for f63e9e3 has started.
⚪ 2024-12-10 17:05:19 UTC Artifacts will be uploaded here
⚪ 2024-12-10 17:08:20 UTC ya make is running...
⚫ 2024-12-10 17:44:35 UTC Check cancelled

github-actions · 2024-12-10T17:49:58Z

⚪ 2024-12-10 17:49:58 UTC Pre-commit check linux-x86_64-release-asan for e82a0d1 has started.
⚪ 2024-12-10 17:50:09 UTC Artifacts will be uploaded here
⚪ 2024-12-10 17:53:09 UTC ya make is running...
🟡 2024-12-10 18:54:56 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15093	15035	0	11	4	43

🟢 2024-12-10 18:56:08 UTC Build successful.
🟡 2024-12-10 18:56:30 UTC ydbd size 3.6 GiB changed* by +119.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `15933e4`	merge: `e82a0d1`	diff	diff %
ydbd size	3 897 229 592 Bytes	3 897 351 864 Bytes	+119.4 KiB	+0.003%
ydbd stripped size	1 366 362 544 Bytes	1 366 397 936 Bytes	+34.6 KiB	+0.003%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-12-10T17:50:08Z

⚪ 2024-12-10 17:50:07 UTC Pre-commit check linux-x86_64-relwithdebinfo for e82a0d1 has started.
⚪ 2024-12-10 17:50:18 UTC Artifacts will be uploaded here
⚪ 2024-12-10 17:53:25 UTC ya make is running...
🟡 2024-12-10 19:27:37 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
32495	29653	0	1	2726	115

⚪ 2024-12-10 19:30:17 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-10 19:41:47 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
685 (only retried tests)	577	0	0	0	108

🟢 2024-12-10 19:41:56 UTC Build successful.
🟢 2024-12-10 19:42:14 UTC ydbd size 2.1 GiB changed* by +83.3 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: `15933e4`	merge: `e82a0d1`	diff	diff %
ydbd size	2 255 451 096 Bytes	2 255 536 368 Bytes	+83.3 KiB	+0.004%
ydbd stripped size	483 817 584 Bytes	483 842 096 Bytes	+23.9 KiB	+0.005%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-12-11T08:21:26Z

⚪ 2024-12-11 08:21:25 UTC Pre-commit check linux-x86_64-release-asan for 2acb8dd has started.
⚪ 2024-12-11 08:22:06 UTC Artifacts will be uploaded here
⚪ 2024-12-11 08:25:54 UTC ya make is running...
🔴 2024-12-11 08:35:02 UTC Build failed, see the logs. Also see fail summary

github-actions · 2024-12-11T08:22:13Z

⚪ 2024-12-11 08:22:12 UTC Pre-commit check linux-x86_64-relwithdebinfo for 2acb8dd has started.
⚪ 2024-12-11 08:22:23 UTC Artifacts will be uploaded here
⚪ 2024-12-11 08:25:24 UTC ya make is running...
🔴 2024-12-11 08:28:36 UTC Build failed, see the logs. Also see fail summary

github-actions · 2024-12-11T08:46:01Z

⚪ 2024-12-11 08:46:00 UTC Pre-commit check linux-x86_64-release-asan for ee35642 has started.
⚪ 2024-12-11 08:46:11 UTC Artifacts will be uploaded here
⚪ 2024-12-11 08:49:10 UTC ya make is running...
🔴 2024-12-11 08:50:55 UTC Build failed, see the logs. Also see fail summary

github-actions · 2024-12-11T08:46:06Z

⚪ 2024-12-11 08:46:05 UTC Pre-commit check linux-x86_64-relwithdebinfo for ee35642 has started.
⚪ 2024-12-11 08:46:17 UTC Artifacts will be uploaded here
⚪ 2024-12-11 08:49:27 UTC ya make is running...
🔴 2024-12-11 08:51:41 UTC Build failed, see the logs. Also see fail summary

github-actions · 2024-12-11T09:42:10Z

⚪ 2024-12-11 09:42:09 UTC Pre-commit check linux-x86_64-relwithdebinfo for e406786 has started.
⚪ 2024-12-11 09:42:20 UTC Artifacts will be uploaded here
⚪ 2024-12-11 09:45:21 UTC ya make is running...
🟡 2024-12-11 10:49:52 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
32511	29582	0	9	2810	110

⚪ 2024-12-11 10:52:35 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-12-11 11:02:06 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
690 (only retried tests)	579	0	7	0	104

⚪ 2024-12-11 11:02:18 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-12-11 11:11:51 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
652 (only retried tests)	542	0	7	0	103

🟢 2024-12-11 11:12:00 UTC Build successful.
🟡 2024-12-11 11:12:21 UTC ydbd size 2.1 GiB changed* by +112.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `e838a62`	merge: `e406786`	diff	diff %
ydbd size	2 255 721 664 Bytes	2 255 836 744 Bytes	+112.4 KiB	+0.005%
ydbd stripped size	483 873 296 Bytes	483 903 376 Bytes	+29.4 KiB	+0.006%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-12-11T09:42:41Z

⚪ 2024-12-11 09:42:41 UTC Pre-commit check linux-x86_64-release-asan for e406786 has started.
⚪ 2024-12-11 09:42:52 UTC Artifacts will be uploaded here
⚪ 2024-12-11 09:46:00 UTC ya make is running...
🟡 2024-12-11 11:01:17 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15097	15012	0	33	6	46

🟢 2024-12-11 11:02:37 UTC Build successful.
🟡 2024-12-11 11:03:01 UTC ydbd size 3.6 GiB changed* by +184.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `e838a62`	merge: `e406786`	diff	diff %
ydbd size	3 897 699 800 Bytes	3 897 888 592 Bytes	+184.4 KiB	+0.005%
ydbd stripped size	1 366 522 384 Bytes	1 366 582 096 Bytes	+58.3 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-12-11T11:19:55Z

⚪ 2024-12-11 11:19:54 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5260b48 has started.
⚪ 2024-12-11 11:20:05 UTC Artifacts will be uploaded here
⚫ 2024-12-11 11:21:40 UTC Check cancelled

github-actions · 2024-12-11T11:23:24Z

⚪ 2024-12-11 11:23:23 UTC Pre-commit check linux-x86_64-release-asan for ef59bad has started.
⚪ 2024-12-11 11:23:27 UTC Artifacts will be uploaded here
⚪ 2024-12-11 11:26:36 UTC ya make is running...
🟡 2024-12-11 12:35:09 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
15097	15009	0	30	9	49

🟢 2024-12-11 12:36:26 UTC Build successful.
🟡 2024-12-11 12:36:57 UTC ydbd size 3.6 GiB changed* by +184.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `95a821a`	merge: `ef59bad`	diff	diff %
ydbd size	3 897 699 816 Bytes	3 897 888 672 Bytes	+184.4 KiB	+0.005%
ydbd stripped size	1 366 522 384 Bytes	1 366 582 160 Bytes	+58.4 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-12-11T11:23:27Z

⚪ 2024-12-11 11:23:27 UTC Pre-commit check linux-x86_64-relwithdebinfo for ef59bad has started.
⚪ 2024-12-11 11:23:39 UTC Artifacts will be uploaded here
⚪ 2024-12-11 11:26:41 UTC ya make is running...
🟡 2024-12-11 12:23:22 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
32511	29589	0	1	2810	111

⚪ 2024-12-11 12:26:12 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-12-11 12:38:33 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
644 (only retried tests)	536	0	1	0	107

⚪ 2024-12-11 12:38:44 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-12-11 12:50:00 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
629 (only retried tests)	522	0	1	0	106

🟢 2024-12-11 12:50:09 UTC Build successful.
🟡 2024-12-11 12:50:32 UTC ydbd size 2.1 GiB changed* by +112.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `95a821a`	merge: `ef59bad`	diff	diff %
ydbd size	2 255 721 680 Bytes	2 255 836 776 Bytes	+112.4 KiB	+0.005%
ydbd stripped size	483 873 296 Bytes	483 903 376 Bytes	+29.4 KiB	+0.006%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

…db-platform#12476)" This reverts commit 7037279.

…form#12476) Тест флаки

scan optimization for filter applying in case simple chunks

c8bfbe5

github-actions bot added the improvement label Dec 10, 2024

fix

7dff7a1

ivanmorozov333 marked this pull request as ready for review December 11, 2024 06:28

ivanmorozov333 requested a review from a team as a code owner December 11, 2024 06:28

optimizations

3159aa8

improving

c0b9c4c

corrections

52bf28c

fix temporary

b6bd1ba

fix

2442036

zverevgeny approved these changes Dec 11, 2024

View reviewed changes

maximyurchuk merged commit 7037279 into ydb-platform:main Dec 11, 2024
7 of 10 checks passed

ivanmorozov333 deleted the scan_optimizations branch December 11, 2024 13:45

iddqdex added a commit to iddqdex/ydb that referenced this pull request Dec 11, 2024

Revert "scan optimization for filter applying in case simple chunks (y…

8bb4246

…db-platform#12476)" This reverts commit 7037279.

GrigoriyPA mentioned this pull request Dec 18, 2024

YQ-3975 RD fixed fault for parsing errors without filter #12707

Merged

iddqdex added a commit to iddqdex/ydb that referenced this pull request Dec 19, 2024

Revert "scan optimization for filter applying in case simple chunks (y…

33947e7

…db-platform#12476)" This reverts commit 7037279.

niksaveliev mentioned this pull request Dec 25, 2024

Kafka connect distributed #12960

Open

zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 2, 2025

scan optimization for filter applying in case simple chunks (ydb-plat…

a7f22ae

…form#12476) Тест флаки

zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 5, 2025

scan optimization for filter applying in case simple chunks (ydb-plat…

a286936

…form#12476) Тест флаки

zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 5, 2025

scan optimization for filter applying in case simple chunks (ydb-plat…

53b0ce9

…form#12476) Тест флаки

zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 8, 2025

scan optimization for filter applying in case simple chunks (ydb-plat…

1ae3179

…form#12476) Тест флаки

zverevgeny mentioned this pull request Jan 9, 2025

Integrate changes from main #13202

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

scan optimization for filter applying in case simple chunks #12476

scan optimization for filter applying in case simple chunks #12476

ivanmorozov333 commented Dec 10, 2024

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

scan optimization for filter applying in case simple chunks #12476

scan optimization for filter applying in case simple chunks #12476

Conversation

ivanmorozov333 commented Dec 10, 2024

github-actions bot commented Dec 10, 2024 • edited Loading

github-actions bot commented Dec 10, 2024 • edited Loading

github-actions bot commented Dec 10, 2024 • edited Loading

github-actions bot commented Dec 10, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 11, 2024 • edited Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 10, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading

github-actions bot commented Dec 11, 2024 •

edited

Loading