Sort (OLDEST) does not work anymore in 0.25.1 --> error in computing/reading the begin offsets

[thibthibus]

Hi,

There was a change in 0.25.1 ( #1817 ?) that led to an erroneous determination / calculation of the beginning offsets for compacted topics.
As a consequence, one cannot display the messages of a Kafka topic using sort (OLDEST).

AKHQ 0.25.1

AKHQ 0.25.0

Kafka CLI

Thanks for looking at this issue

Thibaut

[AlexisSouquiere]

Can you elaborate ? You are not able to see any messages for your compacted topic in AKHQ ?
I just tried again and the result that I have on a compacted topic between AKHQ with the sort oldest or a kafka-console-consumer is the exact same.

But with the kafka-get-offsets script (and the same argument as yours), it's giving me 0 for all the partitions (which is wrong) while the first offset of my partitions are 265, 1015 and 563

[thibthibus]

Hi @AlexisSouquiere
Sorry for the late reply. Actually we faced another issue which is probably related.
We performed an offset update to earliest on a consumer group. After restart the consumer was not able to consume any message in the topic. After analyze we noticed that the offsets had been set to offsets values that don't exist anymore for the topic.
We compared 0.25.1 (and dev) release with 0.25.0 and noticed that the update offsets to earliest was giving different results. With 0.25.1 the operation was returning older offsets for all partitions.
We could confirm that 0.25.0 is correct as it brings the same results as in Confluent Cloud (where we can now perform this operation).
As a consequence we rolled back all our AKHQ instances to 0.25.0.
Hope this helps,
Regards,
Thibaut