Code

add falcon180b FP8 test#104

Code

Merged

libinta merged 9 commits intohabana-mainHabanaAI/optimum-habana-fork:habana-mainfrom schoi/falcon_180b_quant_PRHabanaAI/optimum-habana-fork:schoi/falcon_180b_quant_PRCopy head branch name to clipboardMar 19, 2024

+35-6

Commits

Commits on Mar 6, 2024

• enable Falcon FP8 inference

  

  Local Lab User

  committed
  c72250a

  Copy full SHA for c72250a

Commits on Mar 7, 2024

• added example command in readme, code cleanup

  

  Local Lab User

  committed
  63fd6b2

  Copy full SHA for 63fd6b2

Commits on Mar 8, 2024

• resolve issues in finetuning

  

  Local Lab User

  committed
  af025a7

  Copy full SHA for af025a7

Commits on Mar 11, 2024

• enable non reuse cache flow for fp8

  

  Local Lab User

  committed
  7b9852a

  Copy full SHA for 7b9852a

Commits on Mar 13, 2024

• revert non reuse_cache flow for training due to perf drop

  

  Local Lab User

  committed
  8a18736

  Copy full SHA for 8a18736

• add falcon180B FP8 test

  

  Local Lab User

  committed
  3feaed0

  Copy full SHA for 3feaed0

Commits on Mar 14, 2024

• Merge branch 'habana-main' into schoi/falcon_180b_quant_PR

  

  Local Lab User

  committed
  f849be5

  Copy full SHA for f849be5

• fix error

  

  Local Lab User

  committed
  1b90b33

  Copy full SHA for 1b90b33

Commits on Mar 16, 2024

• fix run_lm_eval.py to save --reuse_cache

  schoi-habana

  committed
  5a2128b

  Copy full SHA for 5a2128b