Code

multi-gpu fix#668

Code

Merged

casper-hansen merged 7 commits intomaincasper-hansen/AutoAWQ:mainfrom fix-multi-gpucasper-hansen/AutoAWQ:fix-multi-gpuCopy head branch name to clipboardDec 3, 2024

+86-85

Commits

Commits on Dec 3, 2024

• initial multi-gpu fix

  casper-hansen

  committed
  9f197be

  Copy full SHA for 9f197be

• minimum transformers 4.45.0

  casper-hansen

  committed
  7d9b539

  Copy full SHA for 7d9b539

• added support for all models

  casper-hansen

  committed
  d9a3c39

  Copy full SHA for d9a3c39

• standardize device_map=None

  casper-hansen

  committed
  18c5208

  Copy full SHA for 18c5208

• standardize low_cpu_mem_usage and use_cache

  casper-hansen

  committed
  dc77595

  Copy full SHA for dc77595

• Fix multi-GPU generation

  casper-hansen

  committed
  621b24a

  Copy full SHA for 621b24a

• updated runpod script

  casper-hansen

  committed
  8b53a84

  Copy full SHA for 8b53a84