lz4 compression

[zmstone]

No description provided.

[XOfSpades]

Is a support of lz4 planned in near future?

[zmstone]

@XOfSpades yes we have.
it's a work in progress.

[zmstone]

https://github.com/martinsumner/erlang-lz4
@qzhuyan ?

[qzhuyan]

Right I forget about my PR, will fix this week.

[zmstone]

it's to be added to kafka_protocol

[zmstone]

The latest kafka_protocol supports (a configurable callback) lz4 compression.
However it's not available to brod yet.
We will back port the feature to kafka_protocol 2.x
created this to follow up: kafka4beam/kafka_protocol#88

Reopen this issue so we can follow up the changes in brod too

[tpitale]

Is there a reason brod hasn't updated to the latest kafka_protocol yet? Not sure if the changes are incompatible or something.

[zmstone]

Is there a reason brod hasn't updated to the latest kafka_protocol yet? Not sure if the changes are incompatible or something.

hi. @tpitale, mostly because I have not managed to get the time for it.

The changes in kafka_protocol are incompatible.
But hopefully we should be able to keep brod APIs compatible

[tpitale]

@zmstone I'm happy to take a run at the changes if you can point me in the general direction.

[zmstone]

@tpitale it's very nice of you to offer help.
let's move the discussion here: #454