2UP memory crash op /Preprocessing/Urban/Population_R2023_Create/Y1975/big_raster/GridData_wo_NoData wegens JenksFischer en vervolgens classify (en dan count op resultaat) die de 64GPix * 8Byte/Pix = 512 GB laat vasthouden.

[MaartenHilferink]

Oplossingsrichtingen:

• JenksFisher op instelbaar maximum aantal elementen laten bepalen (default: 5000 conform qGis, in te stellen bij GuiOptions)
• (default) geen count kolom toevoegen; te overrulen bij GuiOptions
• per expressie instellen of FutureTileFunctor (i.g.v. KeepData ? ) of LazyTileFunctor gebruikt moet worden.

n.b.:

[MaartenHilferink]

LazyCalculation wordt als property toegevoegd om big_raster/GridData_wo_NoData snel zonder veel geheugengebruik te kunnen opvragen in MapView.

[jipclaassens]

same issue #338

[MaartenHilferink]

Now, data is read and displayed in 00:01:52.

[MaartenHilferink]

Note that the LazyCalculated property only affects the final calculation operation of the calculation rule for an item with that property, thus for:

attribute<float32> D := (A+B)+C, LazyCalculated = "True";

D will be calculated lazily, but A+B will be calculated as FutureTileFunctor, thus retaining intermediate results as the LazyTileFunctor for D can continue to request the same tiles as long as it is active. To avoid the related memory consumption, define (A+B) explicitly as a LazyCalculated intermediate result, thus:

  attribute<float32> intermediate := A+B, LazyCalculated = "True";
  attribute<float32> D := intermediate+C, LazyCalculated = "True";