Integration with HF transformers

[younesbelkada]

Hi there,

Thanks for the great work !
We recently added HfQuantizer support in HF transformers thanks to @poedator 's work - I was wondering if it would make sense to create a new quantizer AqlmQuantizer for this method to natively support inference in HF transformers: https://huggingface.co/docs/transformers/main/en/hf_quantizer

Let me know if this makes sense!

[Vahe1994]

Hello!
Thank you for bringing this up. We will take a look and will try to make this AqlmQuantizer for the method to natively support inference in HF.

[BlackSamorez]

I'm on it.

[younesbelkada]

Fantastic work @BlackSamorez !

[BlackSamorez]

Now we wait for the release. After that we can merge #14 and close this issue.

[BlackSamorez]

Starting with transformers 4.38.0, AQLM is supported through quantizers interface.