Removes TokenStream chain.

[fulmicoton]

This change is mostly motivated by the introduction of json object.

We need to be able to inject a position object to make the position
shift.

[codecov-commenter]

Codecov Report

Merging #1283 (8cd4eea) into main (cef1457) will increase coverage by 0.04%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main    #1283      +/-   ##
==========================================
+ Coverage   94.23%   94.28%   +0.04%     
==========================================
  Files         209      208       -1     
  Lines       35287    35135     -152     
==========================================
- Hits        33253    33127     -126     
+ Misses       2034     2008      -26     

Impacted Files	Coverage Δ
src/postings/mod.rs	98.57% <ø> (ø)
src/tokenizer/mod.rs	95.61% <ø> (ø)
src/tokenizer/tokenized_string.rs	77.96% <ø> (-11.89%)	⬇️
src/indexer/segment_writer.rs	92.33% <100.00%> (+0.38%)	⬆️
src/postings/postings_writer.rs	98.17% <100.00%> (+0.10%)	⬆️
src/tokenizer/tokenizer.rs	87.87% <100.00%> (+12.24%)	⬆️

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update cef1457...8cd4eea. Read the comment docs.