Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TSDB: shrink _id inverted index #85008

Merged
merged 6 commits into from
Mar 21, 2022
Merged

Conversation

nik9000
Copy link
Member

@nik9000 nik9000 commented Mar 15, 2022

This shrinks the inverted index for the _id field in tsdb by ~37% by
encoding the @timestamp portion of the _id big endian. Previously
the least significant bits were early in the term which frustred the
prefix-encoded inverted index.

@elasticmachine elasticmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Mar 15, 2022
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo (Team:Analytics)

@elasticsearchmachine
Copy link
Collaborator

Hi @nik9000, I've created a changelog YAML for you.

nik9000 added 2 commits March 15, 2022 16:59
This shrinks the inverted index for the `_id` field in tsdb by ~37% by
encoding the `@timestamp` portion of the `_id` big endian. Previously
the least significant bits were early in the term which frustred the
prefix-encoded inverted index.
@nik9000
Copy link
Member Author

nik9000 commented Mar 16, 2022

@elasticmachine, update branch

@nik9000
Copy link
Member Author

nik9000 commented Mar 16, 2022

@elasticmachine update branch

@nik9000
Copy link
Member Author

nik9000 commented Mar 16, 2022

@elasticmachine update branch

OK robot, I'll do it myself.

@nik9000 nik9000 force-pushed the tsdb_timestamp_be branch from 4a60eff to f044b06 Compare March 18, 2022 14:34
Copy link
Contributor

@romseygeek romseygeek left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@nik9000 nik9000 merged commit a50fc50 into elastic:master Mar 21, 2022
@jpountz
Copy link
Contributor

jpountz commented Mar 21, 2022

Great!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :StorageEngine/TSDB You know, for Metrics Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v8.2.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants