optimizer predicates usage on fetching #1505

ivanmorozov333 · 2024-02-01T09:45:04Z

Changelog entry

dont use predicate columns fetching and filter usage in case whole portion matched in predicates ranges

Changelog category

Performance improvement

Additional information

...

…rtion matched in predicates ranges

github-actions · 2024-02-01T09:48:29Z

⚪ 2024-02-01 09:48:29 UTC Pre-commit check for ffeca1e has started.
⚪ 2024-02-01 09:48:31 UTC Build linux-x86_64-relwithdebinfo is running...
⚫ 2024-02-01 09:52:42 UTC Check cancelled

github-actions · 2024-02-01T09:48:43Z

⚪ 2024-02-01 09:48:43 UTC Pre-commit check for ffeca1e has started.
⚪ 2024-02-01 09:48:46 UTC Build linux-x86_64-release-asan is running...
⚫ 2024-02-01 09:52:43 UTC Check cancelled

github-actions · 2024-02-01T09:53:56Z

⚪ 2024-02-01 09:53:56 UTC Pre-commit check for 2a66675 has started.
⚪ 2024-02-01 09:53:57 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-01 09:57:07 UTC Build successful.
⚪ 2024-02-01 09:57:19 UTC Tests are running...
🔴 2024-02-01 10:00:49 UTC Test run completed, no test results found for commit 7dd47e2. Please check build logs.
⚫ 2024-02-01 10:00:52 UTC Check cancelled

github-actions · 2024-02-01T09:55:58Z

⚪ 2024-02-01 09:55:57 UTC Pre-commit check for 2a66675 has started.
⚪ 2024-02-01 09:56:00 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-01 09:58:59 UTC Build successful.
⚪ 2024-02-01 09:59:13 UTC Tests are running...
🔴 2024-02-01 10:00:48 UTC Test run completed, no test results found for commit 7dd47e2. Please check build logs.
⚫ 2024-02-01 10:00:50 UTC Check cancelled

github-actions · 2024-02-01T10:02:04Z

⚪ 2024-02-01 10:02:04 UTC Pre-commit check for 6cf7bdb has started.
⚪ 2024-02-01 10:02:06 UTC Build linux-x86_64-release-asan is running...
🟢 2024-02-01 10:03:32 UTC Build successful.
⚪ 2024-02-01 10:03:41 UTC Tests are running...
🔴 2024-02-01 11:36:37 UTC Some tests failed, follow the links below.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
16039	15918	0	13	61	47

github-actions · 2024-02-01T10:02:08Z

⚪ 2024-02-01 10:02:07 UTC Pre-commit check for 6cf7bdb has started.
⚪ 2024-02-01 10:02:09 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-02-01 10:03:49 UTC Build successful.
⚪ 2024-02-01 10:03:57 UTC Tests are running...
🟢 2024-02-01 11:14:56 UTC Tests successful.

Test history

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
60356	51052	0	0	9270	34

* dont use predicate columns fetching and filter usage in case whole portion matched in predicates ranges * fix * fix

dont use predicate columns fetching and filter usage in case whole po…

064cece

…rtion matched in predicates ranges

github-actions bot added the performance label Feb 1, 2024

fix

7dd47e2

fix

18585af

nsofya approved these changes Feb 1, 2024

View reviewed changes

ivanmorozov333 merged commit 160238c into ydb-platform:main Feb 1, 2024
3 of 4 checks passed

ivanmorozov333 deleted the optimize_predicate_usage branch February 1, 2024 15:13

This was referenced Feb 2, 2024

YQL-17725 docs for unicode literals #1547

Merged

Fix flaky build #1559

Merged

YQL-17713 warning for unsupported callable #1561

Merged

pavelvelikhov mentioned this pull request Feb 3, 2024

Optimized DPccp #1563

Merged

FloatingCrowbar mentioned this pull request Feb 4, 2024

Сhange keys format for service partitions #1569

Merged

aakulaga-ydb mentioned this pull request Feb 4, 2024

Fix for unequal nulls bitmap size YQL-17564 #1570

Merged

shnikd mentioned this pull request Feb 5, 2024

Support temp tables in yql #1585

Closed

niksaveliev mentioned this pull request Feb 5, 2024

Fixes for kcat #1586

Merged

shnikd mentioned this pull request Feb 5, 2024

Support temp tables in yql #1589

Merged

This was referenced Feb 5, 2024

YQL-17339 import all columns from real PG #1594

Merged

fix aarch64 compile flags #1598

Merged

niksaveliev mentioned this pull request Feb 5, 2024

Fixes lock partition delay and balance test #1600

Merged

pavelvelikhov mentioned this pull request Feb 5, 2024

Generate single JSON with all types of plans in the server #1606

Merged

vitstn mentioned this pull request Feb 5, 2024

YQL-17476 check for cycle during evaluation of file args #1608

Merged

This was referenced Feb 6, 2024

Fix iterator at kafka connect #1611

Closed

Fix iterator at kafka connect #1612

Merged

vitstn mentioned this pull request Feb 6, 2024

parallel for #1650

Merged

vitstn mentioned this pull request Feb 8, 2024

unmute test #1711

Merged

ildar-khisambeev mentioned this pull request Feb 8, 2024

LOGBROKER-8783 bugfix #1713

Merged

vitstn mentioned this pull request Feb 8, 2024

Mark mutable_id for YT writes #1744

Merged

niksaveliev mentioned this pull request Feb 9, 2024

Fix pq writer and few renames #1757

Merged

GrigoriyPA mentioned this pull request Feb 9, 2024

Moved optimizers from yql/providers/dq to yql/dq #1758

Merged

pavelvelikhov mentioned this pull request Feb 9, 2024

Cannonized two plans #1773

Merged

niksaveliev mentioned this pull request Feb 12, 2024

Workload read without consumer and metrics fixes #1792

Merged

starlinskiy mentioned this pull request Feb 12, 2024

runtime dispatching #1800

Closed

vitstn mentioned this pull request Feb 12, 2024

quick fix for column name of select version() #1801

Merged

GrigoriyPA mentioned this pull request Feb 12, 2024

YQ 2786 fix test fq restarts #1810

Merged

vitstn mentioned this pull request Feb 12, 2024

Support of database sys cache #1817

Merged

starlinskiy mentioned this pull request Feb 12, 2024

runtime dispatching (fixed) #1847

Merged

pavelvelikhov mentioned this pull request Feb 13, 2024

Fixed a problem with simplified plan JSONs #1878

Merged

This was referenced Feb 13, 2024

Case insensivity for pg_catalog tables/cluster, columns. Support of pg_class:relam, and some columns in pg_database & pg_namespace #1893

Merged

fixed pg_get_userbyid function #1936

Merged

support of AnyNonArray type, fixes for array_agg #1958

Merged

pavelvelikhov mentioned this pull request Feb 15, 2024

Fixed a problem with plans in PG ut #1974

Merged

niksaveliev mentioned this pull request Feb 16, 2024

Fix kafka with enabled proxy #2017

Merged

vitstn mentioned this pull request Feb 16, 2024

mock of savepoints #2026

Merged

This was referenced Feb 17, 2024

YQ 2786 unmute s3 test bindings #2042

Merged

YQ-2884 fixed fq cancel operation race #2055

Merged

YQ-2883 fix retries for recover point COMPLETING #2107

Merged

YQ-2873 fix hanging in kqp compute actor #2131

Merged

ivanmorozov333 added a commit that referenced this pull request Feb 21, 2024

optimizer predicates usage on fetching (#1505)

0812c2f

* dont use predicate columns fetching and filter usage in case whole portion matched in predicates ranges * fix * fix

GrigoriyPA mentioned this pull request Feb 21, 2024

YQ-2786 partly unmute tests fq s3 #2143

Merged

aakulaga-ydb mentioned this pull request Feb 24, 2024

Fix TzTimestamp wrong encoding (YQL-17920) #2222

Merged

GrigoriyPA mentioned this pull request Feb 26, 2024

YQ-2898 fix query failed with unknown uncommitted upload issue #2240

Merged

ivanmorozov333 added a commit to ivanmorozov333/ydb that referenced this pull request Apr 16, 2024

optimizer predicates usage on fetching (ydb-platform#1505)

050ec9f

* dont use predicate columns fetching and filter usage in case whole portion matched in predicates ranges * fix * fix

ivanmorozov333 added a commit to ivanmorozov333/ydb that referenced this pull request Apr 16, 2024

optimizer predicates usage on fetching (ydb-platform#1505)

7905d7f

* dont use predicate columns fetching and filter usage in case whole portion matched in predicates ranges * fix * fix

ivanmorozov333 added a commit to ivanmorozov333/ydb that referenced this pull request Apr 16, 2024

optimizer predicates usage on fetching (ydb-platform#1505)

fec5aa6

* dont use predicate columns fetching and filter usage in case whole portion matched in predicates ranges * fix * fix

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

optimizer predicates usage on fetching #1505

optimizer predicates usage on fetching #1505

ivanmorozov333 commented Feb 1, 2024

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

optimizer predicates usage on fetching #1505

optimizer predicates usage on fetching #1505

Conversation

ivanmorozov333 commented Feb 1, 2024

Changelog entry

Changelog category

Additional information

github-actions bot commented Feb 1, 2024 • edited Loading

github-actions bot commented Feb 1, 2024 • edited Loading

github-actions bot commented Feb 1, 2024 • edited Loading

github-actions bot commented Feb 1, 2024 • edited Loading

github-actions bot commented Feb 1, 2024 • edited Loading

github-actions bot commented Feb 1, 2024 • edited Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading

github-actions bot commented Feb 1, 2024 •

edited

Loading