Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get from translog fails with large dense_vector (#104700) #104915

Merged
merged 1 commit into from
Jan 30, 2024

Conversation

jimczi
Copy link
Contributor

@jimczi jimczi commented Jan 30, 2024

Backport of #104700

This change fixes the engine to apply the current codec when retrieving documents from the translog.
We need to use the same codec than the main index in order to ensure that all the source data is indexable.
The internal codec treats some fields differently than the default one, for instance dense_vectors are limited to 1024 dimensions.
This PR ensures that these customizations are applied when indexing document for translog retrieval.

Closes elastic#104639

Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>
@jimczi jimczi added >bug :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. backport v8.12.1 labels Jan 30, 2024
@jimczi jimczi requested a review from pxsalehi January 30, 2024 15:44
@jimczi jimczi merged commit 2258610 into elastic:8.12 Jan 30, 2024
15 checks passed
@jimczi jimczi deleted the backport_8_12_104700 branch January 30, 2024 15:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport >bug :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. v8.12.1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants