Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gather CountMinSketch statistics from Column tables #5867

Closed
ildar-khisambeev opened this issue Jun 24, 2024 · 3 comments
Closed

Gather CountMinSketch statistics from Column tables #5867

ildar-khisambeev opened this issue Jun 24, 2024 · 3 comments
Assignees
@ildar-khisambeev

Comments

@ildar-khisambeev
Copy link
Contributor

ildar-khisambeev commented Jun 24, 2024 •
edited
Loading

Steps:

  1. DONE use the same TEvStatisticsRequest / TEvStatisticsResponse interface for datashard / columnshard
    move statistics messages #5820
  2. implement Count-Min Sketch with already given statistics interface https://github.com/ydb-platform/ydb/blob/main/ydb/core/tx/columnshard/engines/scheme/statistics/abstract
  3. statistics merge logic on granule level
  4. fill pre-counted statistics on TEvStatisticsRequest handling
@ildar-khisambeev ildar-khisambeev self-assigned this Jun 24, 2024
@zverevgeny zverevgeny changed the title Gather CMS statistics from OLAP tables Gather CountMinSketch statistics from Column tables Jun 26, 2024
@ildar-khisambeev
Copy link
Contributor Author

https://wiki.yandex-team.ru/users/nsofya/ydb/statistics/
https://wiki.yandex-team.ru/kikimr/design/datashard/statistics/columnshard-traversal/

@ildar-khisambeev
Copy link
Contributor Author

Describe a case, when setting up statistics gathering for a column already containing data

@ildar-khisambeev
Copy link
Contributor Author

Done in #7978

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ildar-khisambeev ildar-khisambeev

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ildar-khisambeev