Code

LLM: 2bit quantization support#10042

Code

Merged

rnwang04 merged 8 commits intointel:mainintel/ipex-llm:mainfrom rnwang04:support_iq2Copy head branch name to clipboardFeb 6, 2024

+164-22

Commits

Commits on Feb 6, 2024

• basis quantize support

  rnwang04

  committed
  fbd8b00

  Copy full SHA for fbd8b00

• fix new module name

  rnwang04

  committed
  cb5e320

  Copy full SHA for cb5e320

• small update

  rnwang04

  committed
  bdeabe0

  Copy full SHA for bdeabe0

• and mixed int4 with iq2_xxs

  rnwang04

  committed
  67037c9

  Copy full SHA for 67037c9

• remove print

  rnwang04

  committed
  313fb4e

  Copy full SHA for 313fb4e

• code refactor

  rnwang04

  committed
  300e097

  Copy full SHA for 300e097

• fix style

  rnwang04

  committed
  a543a81

  Copy full SHA for a543a81

• meet code review

  rnwang04

  committed
  21a2124

  Copy full SHA for 21a2124