A cheat sheet with five useful inequalities
Our work implements novel L2-Norm gradient (L2Grad) and variance of the weight distrbution (VarianceNorm) regularizers for quantization-aware training such that the distribution of weights are more compatible with post-training quantization especially for low bit-widths. We provide a theoretical basis that directly relates L2-Grad with post quan…
Add a description, image, and links to the cauchy-schwarz-inequality topic page so that developers can more easily learn about it.
To associate your repository with the cauchy-schwarz-inequality topic, visit your repo's landing page and select "manage topics."