CategoricalValue allocates on julia 1.11

[tiemvanderdeure]

MWE

using CategoricalArrays
A = rand(1:10, 1000)
Acat = categorical(A)
@allocations getindex.(Ref(Acat),eachindex(Acat))

On julia 1.11.2, this gives 1020 allocations (vs 17 on julia 1.10.7). The computation time is also ~ doubled. I profiled and it seems each call to CategoricalValue generates an allocation.