Skip to content

Commit

Permalink
[Feat]: Add support for kleidiai quantization schemes
Browse files Browse the repository at this point in the history 
Description:
1. Allow Int4WeightOnlyQuantizer to work with channelwise and groupwise
symmetric quantization schemes
2. KleidiAI supports channelwise and 32 groupwise quantized matmul
   kernels

Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
  • Loading branch information
@ng-05
ng-05 committed Dec 19, 2024
1 parent 2e032c6 commit 738d7f2
Show file tree
Hide file tree
Showing 2 changed files with 354 additions and 60 deletions.
Loading

0 comments on commit 738d7f2

Please sign in to comment.