Zstd compression level always reported as 1?

[javafanboy]

I created a bunch of Parquet files with Zstd compression and tried different levels, the time taken was different and file size changed but PQRS always reported Zstd(level 1) when I did schema --detailed.

This is on MAC / MacOS / M3.

[ttencate]

Heh, I noticed this too last week, and just now spotted your issue. I think I can explain. The compression level that was used to create the file isn't actually stored in the Parquet file anywhere. Level 1 is reported because the parquet library requires a compression level in the enum, and 1 is the default for ZstdLevel.

pqrs could fix this without any changes needed to the upstream parquet library by omitting everything from the first ( onwards. I'll send a PR.

Edit: actually the printing does come from upstream, here. I'll send the PR there :)

[ttencate]

It's been fixed upstream. I suppose this issue can be closed, or do you want to wait for a release?

[javafanboy]

No that is fine - mostly wanted a confirmation - this "1" sent me on a chase of errors in my code for not setting the desired compression level ...