Code

Zarr driver#3896

Code

Merged

rouault merged 67 commits intoOSGeo:masterOSGeo/gdal:masterfrom rouault:zarrrouault/gdal:zarrCopy head branch name to clipboardJul 19, 2021

Commits

Commits on Jul 12, 2021

• Zarr driver: initial piece of multidimensional read side

  rouault

  committedJul 12, 2021
  690bbb0

  Copy full SHA for 690bbb0

• Zarr: test invalid values in .zarray

  rouault

  committedJul 12, 2021
  f90ea6f

  Copy full SHA for f90ea6f

• Zarr: test negative array steps

  rouault

  committedJul 12, 2021
  3a9a5f1

  Copy full SHA for 3a9a5f1

• Zarr: do not restrict some variables to size_t

  rouault

  committedJul 12, 2021
  b89a50a

  Copy full SHA for b89a50a

• Zarr: IRead() performance improvements

  rouault

  committedJul 12, 2021
  e6d357b

  Copy full SHA for e6d357b

• Add cpl_compressor.h to register compression/decompression functions

  rouault

  committedJul 12, 2021
  199c937

  Copy full SHA for 199c937

• Add support for Blosc compressor

  rouault

  committedJul 12, 2021
  7f5434c

  Copy full SHA for 7f5434c

• Docker alpine-normal: add cblosc

  rouault

  committedJul 12, 2021
  7dd10a1

  Copy full SHA for 7dd10a1

• Zarr: add support for compressor

  rouault

  committedJul 12, 2021
  6577877

  Copy full SHA for 6577877

• CPLZLibDeflate(): honour nLevel parameter, and improve auto-mem allocation for libdeflate code path

  rouault

  committedJul 12, 2021
  952fb11

  Copy full SHA for 952fb11

• Add ZLib compressor

  rouault

  committedJul 12, 2021
  01b3560

  Copy full SHA for 01b3560

• Add LZMA compressor

  rouault

  committedJul 12, 2021
  84e1ac5

  Copy full SHA for 84e1ac5

• Add ZSTD compressor

  rouault

  committedJul 12, 2021
  c473d18

  Copy full SHA for c473d18

• Add LZ4 compressor

  rouault

  committedJul 12, 2021
  4e3ebca

  Copy full SHA for 4e3ebca

• Add GZip compressor

  rouault

  committedJul 12, 2021
  80f2b1b

  Copy full SHA for 80f2b1b

• autotest: do not recurse in gdrivers/data

  rouault

  committedJul 12, 2021
  78e2aaa

  Copy full SHA for 78e2aaa

• Zarr: add testing for reading dataset compressed with various methods

  rouault

  committedJul 12, 2021
  4856be9

  Copy full SHA for 4856be9

• Zarr: add support for i1, i8 and u8 typestr

  rouault

  committedJul 12, 2021
  5319498

  Copy full SHA for 5319498

• Zarr: cache last decoded tile

  rouault

  committedJul 12, 2021
  80a12e3

  Copy full SHA for 80a12e3

• Zarr: support Fortran ordering of blocks

  rouault

  committedJul 12, 2021
  ae60ec3

  Copy full SHA for ae60ec3

• Zarr: add support for compound data types

  rouault

  committedJul 12, 2021
  fa2282b

  Copy full SHA for fa2282b

• Zarr: support reading array attributes

  rouault

  committedJul 12, 2021
  8481061

  Copy full SHA for 8481061

• Zarr: read CRS from a 'crs' member in .zattrs

  rouault

  committedJul 12, 2021
  9ba8297

  Copy full SHA for 9ba8297

• Zarr: add support for groups

  rouault

  committedJul 12, 2021
  c595e59

  Copy full SHA for c595e59

• Zarr: support loading hiearchy from consolidated .zmetadata

  rouault

  committedJul 12, 2021
  2962d48

  Copy full SHA for 2962d48

• Zarr: defer allocation of array working buffers

  rouault

  committedJul 12, 2021
  17de58b

  Copy full SHA for 17de58b

• Zarr: add a USE_ZMETADATA open option

  rouault

  committedJul 12, 2021
  605b59b

  Copy full SHA for 605b59b

• Zarr: take into account XArray _ARRAY_DIMENSIONS attribute

  rouault

  committedJul 12, 2021
  f76b90d

  Copy full SHA for f76b90d

• Zarr: add support for ZarrV3

  rouault

  committedJul 12, 2021
  2751e95

  Copy full SHA for 2751e95

• Zarr: Add support for half-float

  rouault

  committedJul 12, 2021
  2405602

  Copy full SHA for 2405602

• Zarr: add support for exposing as classic raster

  rouault

  committedJul 12, 2021
  c9242d1

  Copy full SHA for c9242d1

• Zarr: be tolerant with numeric fill_value stored as string

  rouault

  committedJul 12, 2021
  70a0e37

  Copy full SHA for 70a0e37

• Zarr: accept a filters member with a 0-length array

  rouault

  committedJul 12, 2021
  f0b0bd3

  Copy full SHA for f0b0bd3

• Zarr: support empty shape

  rouault

  committedJul 12, 2021
  e726cdb

  Copy full SHA for e726cdb

• Zarr: add a driver BLOSC_COMPRESSORS metadata item

  rouault

  committedJul 12, 2021
  744b930

  Copy full SHA for 744b930

• Zarr: implement CreateMultiDimensional() and group creation

  rouault

  committedJul 12, 2021
  a872f0d

  Copy full SHA for a872f0d

• Add CPLJSONDocument::SetRoot()

  rouault

  committedJul 12, 2021
  d4bfd57

  Copy full SHA for d4bfd57

• MEMMultiDim: add MEMAbstractMDArray::SetWritable, IsModified and SetModified methods

  rouault

  committedJul 12, 2021
  8a1e314

  Copy full SHA for 8a1e314

• Zarr: add support for creating/modifying group attributes

  rouault

  committedJul 12, 2021
  a297878

  Copy full SHA for a297878

• Zarr: split code into multiple files

  rouault

  committedJul 12, 2021
  ddf516c

  Copy full SHA for ddf516c

• GTiff: make FloatToHalf() available to other drivers

  rouault

  committedJul 12, 2021
  c9569ee

  Copy full SHA for c9569ee

• Zarr: preliminary support for creating arrays (just metadata)

  rouault

  committedJul 12, 2021
  1b44ef2

  Copy full SHA for 1b44ef2

• Zarr: write side: add metadata support for compression method

  rouault

  committedJul 12, 2021
  1b55d99

  Copy full SHA for 1b55d99

• Zarr: add write support for array attributes

  rouault

  committedJul 12, 2021
  710438d

  Copy full SHA for 710438d

• Zarr: add write support for CRS

  rouault

  committedJul 12, 2021
  37dc8d6

  Copy full SHA for 37dc8d6

• Zarr: add write support for XArray's _ARRAY_DIMENSIONS

  rouault

  committedJul 12, 2021
  2b93b07

  Copy full SHA for 2b93b07

• Zarr: implement array value writing

  rouault

  committedJul 12, 2021
  7622fe2

  Copy full SHA for 7622fe2

• netCDF: move CF constants to netcdf_cf_constants.h header

  rouault

  committedJul 12, 2021
  dc91257

  Copy full SHA for dc91257

• Zarr: add support for unit, scale, offset using CF conventions

  rouault

  committedJul 12, 2021
  ae378de

  Copy full SHA for ae378de

• Zarr: implement GetCoordinateVariables()

  rouault

  committedJul 12, 2021
  9fa7377

  Copy full SHA for 9fa7377

• Zarr: implement classic raster Create() API

  rouault

  committedJul 12, 2021
  d2fcad9

  Copy full SHA for d2fcad9

• Zarr: check for too large block size

  rouault

  committedJul 12, 2021
  c6b13bd

  Copy full SHA for c6b13bd

• Zarr: add ZarrV3 group creation

  rouault

  committedJul 12, 2021
  f598f91

  Copy full SHA for f598f91

• Zarr: add ZarrV3 array creation

  rouault

  committedJul 12, 2021
  c56eb1e

  Copy full SHA for c56eb1e

• Doc building: add a supports_multidimensional directive

  rouault

  committedJul 12, 2021
  6291288

  Copy full SHA for 6291288

• Zarr: add documentation page

  rouault

  committedJul 12, 2021
  9ea53b4

  Copy full SHA for 9ea53b4

• Zarr: set TYPESIZE with Blosc compression

  rouault

  committedJul 12, 2021
  b3a28a7

  Copy full SHA for b3a28a7

• /vsicurl/: fix to be able to read /vsis3/zarr-demo/store/spam

  rouault

  committedJul 12, 2021
  b2e4b40

  Copy full SHA for b2e4b40

• Add CPLJSONObject::DeleteNoSplitName()

  rouault

  committedJul 12, 2021
  6356d9b

  Copy full SHA for 6356d9b

• Zarr: add creation/update support for consolidated metadata .zmetadata

  rouault

  committedJul 12, 2021
  99962ae

  Copy full SHA for 99962ae

• Compressor API: add support for Delta filter restricted to dtype=astype

  rouault

  committedJul 12, 2021
  e3b5f77

  Copy full SHA for e3b5f77

• Zarr: add read/update support for filters (limited to delta filter for now)

  rouault

  committedJul 12, 2021
  b36c2d8

  Copy full SHA for b36c2d8

• Zarr: add read support for NCZarr way of setting fill_value

  rouault

  committedJul 12, 2021
  0f006be

  Copy full SHA for 0f006be

• Zarr: add creation option FILTER (Zarr V2 only)

  rouault

  committedJul 12, 2021
  80ec6da

  Copy full SHA for 80ec6da

• Zarr: turn on -Weffc++ -Wold-style-cast

  rouault

  committedJul 12, 2021
  faf0616

  Copy full SHA for faf0616

• Zarr V3: use singular form for codec URL

  rouault

  committedJul 12, 2021
  dc63e21

  Copy full SHA for dc63e21

• zarr/GNUmakefile: use -iquote

  rouault

  committedJul 12, 2021
  6c04756

  Copy full SHA for 6c04756