Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aggregation #2

Closed
wants to merge 327 commits into from
Closed

aggregation #2

wants to merge 327 commits into from

Conversation

PSeitz
Copy link
Owner

@PSeitz PSeitz commented Feb 21, 2022

appaquet and others added 30 commits June 13, 2021 16:49
replace test with smaller test in doc_store
…terator

Fix panic in store reader raw document iterator during segment merge
support multiple codes
prepend codec id to all fast fields
add new api to create fastfields with access to all data
use new fastfield creation api in initial creation and merge
remove unused collect of data in doc_id_mapping
move common to common crate
create fastfield_codecs crate
add bitpacker to fast field codecs
add linear interpolation to fast field codecs
add tests
change api to fastfield reader in codec crate
add fastfield metadata to footer
remove old code
merge codec files
add estimation tests
add codec test data in tests
add CodecReader as common interface in fastfield codec crate
add LinearInterpolation to DynamicFastFieldReader
calc estimation and choose best codec
cleanup
test tests::bench_fastfield_bitpack_create        ... bench:      57,628 ns/iter (+/- 23,486)
test tests::bench_fastfield_bitpack_get           ... bench:      43,323 ns/iter (+/- 4,286)
test tests::bench_fastfield_linearinterpol_create ... bench:     223,625 ns/iter (+/- 33,563)
test tests::bench_fastfield_linearinterpol_get    ... bench:      82,839 ns/iter (+/- 9,575)
add multilinearinterpolation, which compresses blocks of size 512
add checks for linear interpolation
saroh and others added 29 commits January 3, 2022 22:20
* doc(termdict) expose structs
also add merger doc + lint
refs quickwit-oss#1232
* Change Snippet.fragments -> Snippet.fragment
* Apply suggestions from code review

Co-authored-by: Liam Warfield <lwarfield@arista.com>
The test-env-log crate has been renamed to test-log to better reflect
its intent of not only catering to env_logger specific initialization
but also tracing (and potentially others in the future).
This change updates the crate to use test-log instead of the now
deprecated test-env-log.
* doc(collector)

* doc(directory)

* doc(misc)

* wording
* Term are now typed.

This change is backward compatible:
While the Term has a byte representation that is modified, a Term itself
is a transient object that is not serialized as is in the index.

Its .field() and .value_bytes() on the other hand are unchanged.
This change offers better Debug information for terms.

While not necessary it also will help in the support for JSON types.

* Renamed Hierarchical Facet -> Facet
Adds an API to register Warmers in the IndexReader.

Co-authored-by: Paul Masurel <paul@quickwit.io>
Updates the requirements on fastdivide to permit the latest version.

---
updated-dependencies:
- dependency-name: fastdivide
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Add Vaporetto tokenizer to README

* Update README.md
* Fix opening bytes index with dynamic codec

Fix quickwit-oss#1278

* extend proptest to cover bytes field codec bug
This change is mostly motivated by the introduction of json object.

We need to be able to inject a position object to make the position
shift.
Added support for aggregation compatible with Elasticsearch's API.
@PSeitz PSeitz closed this Feb 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment