An Archiving Split Policy For Managing Non-Searchable Documents [LUCENE-2430]

[asfimport]

(Please note that the feature described in #3499 is required reading for this issue.)

The archiving split policy extends the rotating split policy by archiving sub-indices over-flowing from the split index. This allows for older documents that are "past their prime" to be available outside the context of the split index, even if they are no longer visible therein.

It does so by overriding the RotatingSplitPolicy#maybeExpungeOldestSplit method. In particular, it archives (i.e., makes a copy of) the last sub-index (about to be expunged), just before the rotating policy actually expunges it.

Just like the rotating split policy constrains the number of sub-indices, the archiving split policy too puts a limit on the number of sub-archives (i.e. sub-indices that have been archived and expunged) that the split index will maintain at any given point in time.

---

Migrated from LUCENE-2430 by Karthick Sankarachary, updated May 04 2010
Attachments: LUCENE-2430.patch
Linked issues:

• An Anti-Merging Multi-Directory Indexing Framework [LUCENE-2425] #3499