Pinned Loading

1. CLAIRE-Labo/StructuredFFN CLAIRE-Labo/StructuredFFN Public

   The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"

   Python 19 3

2. QDrop QDrop Public

   The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quantization

   Python 119 17

3. outlier_suppression outlier_suppression Public

   The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer Language Models

   Python 47 4

4. ModelTC/Outlier_Suppression_Plus ModelTC/Outlier_Suppression_Plus Public

   Official implementation of the EMNLP23 paper: Outlier Suppression+: Accurate quantization of large language models by equivalent and optimal shifting and scaling

   Python 47 4