Code

Enable ROCm whls#39

Code

Merged

pnunna93 merged 92 commits intodevice_abstractionROCm/bitsandbytes:device_abstractionfrom enable_rocm_whlsROCm/bitsandbytes:enable_rocm_whlsCopy head branch name to clipboardJul 31, 2024

+945-143

Commits

Commits on May 6, 2024

• doc-builder image had been changed, need to revert to old one due to dependency issues, see https://huggingface.slack.com/archives/C021H1P1HKR/p1714469081588139

  Titus-von-Koeller

  committed
  7772fa3

  Copy full SHA for 7772fa3

Commits on May 7, 2024

• Update CONTRIBUTING.md

  Titus-von-Koeller

  authored
  b659c70

  Copy full SHA for b659c70

• Update README.md

  Titus-von-Koeller

  authored
  b97ea77

  Copy full SHA for b97ea77

• Update README.md

  Titus-von-Koeller

  authored
  b891f80

  Copy full SHA for b891f80

Commits on May 8, 2024

• Support NF4 on CPU backend

  Xia-Weiwen

  committed
  09cc153

  Copy full SHA for 09cc153

Commits on May 10, 2024

• Minor improvements

  Xia-Weiwen

  committed
  177bd39

  Copy full SHA for 177bd39

Commits on May 11, 2024

• Add fp4 support; add UT; fix lint issues

  Xia-Weiwen

  committed
  881b5fc

  Copy full SHA for 881b5fc

• Reduce memory usage

  Xia-Weiwen

  committed
  dd15734

  Copy full SHA for dd15734

• Fix UT

  Xia-Weiwen

  committed
  85a01b0

  Copy full SHA for 85a01b0

• reduce memory usage for nf4

  Xia-Weiwen

  committed
  2c489f8

  Copy full SHA for 2c489f8

Commits on May 13, 2024

• clarify

  stevhliu

  committed
  13c70d3

  Copy full SHA for 13c70d3

Commits on May 14, 2024

• clarify

  stevhliu

  committed
  2b7daed

  Copy full SHA for 2b7daed

Commits on May 16, 2024

• feedback

  stevhliu

  committed
  d7a5a24

  Copy full SHA for d7a5a24

Commits on May 19, 2024

• Merge pull request bitsandbytes-foundation#1211 from stevhliu/fix

  Show description for 25abf8d
  Titus-von-Koeller

  authored
  25abf8d

  Copy full SHA for 25abf8d

Commits on May 20, 2024

• Update matplotlib requirement from ~=3.8.4 to ~=3.9.0 in the major group

  Show description for c51437b
  dependabot[bot]

  authored
  c51437b

  Copy full SHA for c51437b

• Bump pytest from 8.2.0 to 8.2.1 in the minor-patch group

  Show description for fa65a9d
  dependabot[bot]

  authored
  fa65a9d

  Copy full SHA for fa65a9d

Commits on May 23, 2024

• Merge pull request bitsandbytes-foundation#1215 from TimDettmers/dependabot/pip/major-2d933c583a

  Show description for be6700b
  Titus-von-Koeller

  authored
  be6700b

  Copy full SHA for be6700b

• Merge pull request bitsandbytes-foundation#1216 from TimDettmers/dependabot/pip/minor-patch-0d8eea7cf4

  Show description for 328b5a9
  Titus-von-Koeller

  authored
  328b5a9

  Copy full SHA for 328b5a9

Commits on May 24, 2024

• Merge pull request bitsandbytes-foundation#1206 from Xia-Weiwen/multi-backend-refactor-cpu-4bit

  Show description for 701c5aa
  Titus-von-Koeller

  authored
  701c5aa

  Copy full SHA for 701c5aa

• Merge pull request bitsandbytes-foundation#1207 from ROCm/device_abstraction

  Show description for eb3b816
  Titus-von-Koeller

  authored
  eb3b816

  Copy full SHA for eb3b816

• README: ask for help from volunteer alpha testers

  Titus-von-Koeller

  authored
  79815ad

  Copy full SHA for 79815ad

Commits on May 26, 2024

• Add "lamb" to str2optimizer32bit

  IndigoDosSantos

  authored
  a9a1c44

  Copy full SHA for a9a1c44

Commits on May 27, 2024

• Add empty stubs for Ascend NPU

  ji-huazhong

  committed
  ccee5d8

  Copy full SHA for ccee5d8

• Bump scipy from 1.13.0 to 1.13.1 in the minor-patch group

  Show description for a8644b7
  dependabot[bot]

  authored
  a8644b7

  Copy full SHA for a8644b7

Commits on May 28, 2024

• Merge pull request bitsandbytes-foundation#1223 from statelesshz/backend-npu

  Show description for 09c314a
  Titus-von-Koeller

  authored
  09c314a

  Copy full SHA for 09c314a

• Merge pull request bitsandbytes-foundation#1224 from TimDettmers/dependabot/pip/minor-patch-5c00aa8ad3

  Show description for c08653b
  Titus-von-Koeller

  authored
  c08653b

  Copy full SHA for c08653b

• Merge branch 'main' into multi-backend-refactor

  Titus-von-Koeller

  committed
  2dbf876

  Copy full SHA for 2dbf876

• Merge branch 'TimDettmers:main' into main

  IndigoDosSantos

  authored
  227d904

  Copy full SHA for 227d904

• Sorted alphabetically for better overview

  IndigoDosSantos

  authored
  2e46eef

  Copy full SHA for 2e46eef

• Update functional.py

  IndigoDosSantos

  authored
  7a338db

  Copy full SHA for 7a338db

Commits on May 29, 2024

• FIX Prevent __getstate__ from mutating Params4bit

  Show description for 2fb212b
  BenjaminBossan

  committed
  2fb212b

  Copy full SHA for 2fb212b

• fix blocksize

  jiqing-feng

  committed
  36fe1a0

  Copy full SHA for 36fe1a0

Commits on May 30, 2024

• FIX Make Int8Params deepcopy-able

  Show description for ed99b3c
  BenjaminBossan

  committed
  ed99b3c

  Copy full SHA for ed99b3c

• Merge pull request bitsandbytes-foundation#1231 from BenjaminBossan/fix-8bit-deepcopy

  Show description for 3c8c18a
  Titus-von-Koeller

  authored
  3c8c18a

  Copy full SHA for 3c8c18a

• Merge pull request bitsandbytes-foundation#1230 from BenjaminBossan/fix-4bit-getstate

  Show description for d9b1125
  Titus-von-Koeller

  authored
  d9b1125

  Copy full SHA for d9b1125

• Merge pull request bitsandbytes-foundation#1222 from EtienneDosSantos/main

  Show description for 1f2ca43
  Titus-von-Koeller

  authored
  1f2ca43

  Copy full SHA for 1f2ca43

• Merge pull request bitsandbytes-foundation#1228 from jiqing-feng/4bit

  Show description for dba8376
  Titus-von-Koeller

  authored
  dba8376

  Copy full SHA for dba8376

Commits on Jun 5, 2024

• fix for faulty bitsandbytes-foundation#1222 ("Add "lamb" to str2optimizer32bit") (bitsandbytes-foundation#1240)

  Show description for b22ae26
  younesbelkada

  authored
  b22ae26

  Copy full SHA for b22ae26

Commits on Jun 6, 2024

• CPU: add torch.compile for F.double_quant and F.quantize_4bit (bitsandbytes-foundation#1238)

  Xia-Weiwen

  authored
  517eaf2

  Copy full SHA for 517eaf2

Commits on Jun 19, 2024

• Add build job for rocm

  pnunna93

  committed
  5891465

  Copy full SHA for 5891465

• Add rocm build script

  pnunna93

  committed
  d03a680

  Copy full SHA for d03a680

Commits on Jun 20, 2024

• Copy shared obj file into output_dir

  pnunna93

  committed
  ec9000f

  Copy full SHA for ec9000f

• upload build artifacts and enable wheels build

  pnunna93

  committed
  9b8c1da

  Copy full SHA for 9b8c1da

• Remove cuda build temporarily

  pnunna93

  authored
  1413c5f

  Copy full SHA for 1413c5f

Commits on Jun 21, 2024

• Bump the minor-patch group across 1 directory with 2 updates (bitsandbytes-foundation#1253)

  Show description for 195ae61
  dependabot[bot]

  authored
  195ae61

  Copy full SHA for 195ae61

• cleanup docs-build breaking install instructs (bitsandbytes-foundation#1244)

  Show description for 193120d
  

  Titus-von-Koeller

  and

  pnunna93

  authored
  193120d

  Copy full SHA for 193120d

• cpu install guide (bitsandbytes-foundation#1227)

  Show description for dada530
  

  jiqing-feng

  and

  stevhliu

  authored
  dada530

  Copy full SHA for dada530

• provide temp flag for outside libs to detect multi-backend preview (bitsandbytes-foundation#1243)

  Show description for c79b1e9
  

  Titus-von-Koeller

  and

  BenjaminBossan

  authored
  c79b1e9

  Copy full SHA for c79b1e9

Commits on Jul 10, 2024

• CPU/XPU: disable torch.compile if g++ is not available (bitsandbytes-foundation#1251)

  Show description for 1bfecc8
  Xia-Weiwen

  authored
  1bfecc8

  Copy full SHA for 1bfecc8

Commits on Jul 12, 2024

• Create build job for ROCm (bitsandbytes-foundation#1255)

  Show description for 0859784
  pnunna93

  authored
  0859784

  Copy full SHA for 0859784

• fix broken <source> links in autodoc API reference (bitsandbytes-foundation#1275)

  Show description for 1935a45
  Titus-von-Koeller

  authored
  1935a45

  Copy full SHA for 1935a45

• Fix CUDA 12.5 build issue (bitsandbytes-foundation#1273)

  Show description for 85e0127
  HennerM

  authored
  85e0127

  Copy full SHA for 85e0127

• Bump scipy from 1.13.1 to 1.14.0 in the minor-patch group (bitsandbytes-foundation#1266)

  Show description for 6866a4a
  dependabot[bot]

  authored
  6866a4a

  Copy full SHA for 6866a4a

• update repo owner

  Titus-von-Koeller

  authored
  8c6ab69

  Copy full SHA for 8c6ab69

• update repo owner

  Titus-von-Koeller

  authored
  7be1143

  Copy full SHA for 7be1143

Commits on Jul 15, 2024

• Fix Windows CUDA build compatibility with newest MSVC (bitsandbytes-foundation#1276)

  Show description for 6948f0b
  matthewdouglas

  authored
  6948f0b

  Copy full SHA for 6948f0b

• Update matplotlib requirement from ~=3.9.0 to ~=3.9.1 in the major group (bitsandbytes-foundation#1278)

  Show description for f2b2310
  dependabot[bot]

  authored
  f2b2310

  Copy full SHA for f2b2310

• Fixed tests for cpu only platforms (bitsandbytes-foundation#1259)

  Show description for 39b42e7
  galqiwi

  authored
  39b42e7

  Copy full SHA for 39b42e7

Commits on Jul 16, 2024

• fix QLoRA mem bug: delete useless buffered activation (bitsandbytes-foundation#1270)

  Show description for 9e75374
  Ther-nullptr

  authored
  9e75374

  Copy full SHA for 9e75374

Commits on Jul 21, 2024

• Add CUDA 12.5 and update 12.4 builds (bitsandbytes-foundation#1284)

  Show description for 0bdd57c
  matthewdouglas

  authored
  0bdd57c

  Copy full SHA for 0bdd57c

Commits on Jul 22, 2024

• Edenzzzz's fix for min_8bit_size functionality in Optimizer base classes (bitsandbytes-foundation#1286)

  Show description for 5212a0f
  

  Titus-von-Koeller

  and

  Edenzzzz

  authored
  5212a0f

  Copy full SHA for 5212a0f

• Fixed optim update error with non-contiguous grads/params (bitsandbytes-foundation#1187)

  Show description for a3f55ce
  

  Edenzzzz

  and

  Titus-von-Koeller

  authored
  a3f55ce

  Copy full SHA for a3f55ce

• Bump pytest from 8.2.2 to 8.3.1 in the minor-patch group (bitsandbytes-foundation#1287)

  Show description for e3ae243
  dependabot[bot]

  authored
  e3ae243

  Copy full SHA for e3ae243

Commits on Jul 23, 2024

• Fix restoration of quant_storage for CPU offloading (bitsandbytes-foundation#1279)

  Show description for 7fed393
  

  matthewdouglas

  and

  Titus-von-Koeller

  authored
  7fed393

  Copy full SHA for 7fed393

• remove unnecessary version mention

  Titus-von-Koeller

  committed
  1571110

  Copy full SHA for 1571110

• release 0.43.2

  Titus-von-Koeller

  committed
  ce53caf

  Copy full SHA for ce53caf

• bump version tag to next dev

  Titus-von-Koeller

  committed
  a7c08af

  Copy full SHA for a7c08af

Commits on Jul 24, 2024

• Changelog: add explanation r. QLoRA mem savings

  Titus-von-Koeller

  committed
  9b72679

  Copy full SHA for 9b72679

Commits on Jul 26, 2024

• merge main into multi-backend-refactor

  Titus-von-Koeller

  committed
  056011a

  Copy full SHA for 056011a

Commits on Jul 27, 2024

• docs: add more details to Intel install

  Titus-von-Koeller

  committed
  81375f8

  Copy full SHA for 81375f8

• Changelog: add explanation r. QLoRA mem savings

  Titus-von-Koeller

  committed
  7800734

  Copy full SHA for 7800734

• docs: cleanup of compilation instructions

  Titus-von-Koeller

  committed
  24f7b65

  Copy full SHA for 24f7b65

• docs: CHANGELOG.md fix

  Titus-von-Koeller

  committed
  e3b2780

  Copy full SHA for e3b2780

• Merge remote-tracking branch 'upstream/main' into multi-backend-refactor

  Titus-von-Koeller

  committed
  0b53d31

  Copy full SHA for 0b53d31

• fix dtype mismatch (bitsandbytes-foundation#1285)

  jiqing-feng

  authored
  c8b4b33

  Copy full SHA for c8b4b33

Commits on Jul 29, 2024

• Add ROCm version to .so filename

  pnunna93

  committed
  fd655b0

  Copy full SHA for fd655b0

• Add rocm_version to whls build

  pnunna93

  committed
  6b77f4c

  Copy full SHA for 6b77f4c

• Revert "Remove cuda build temporarily"

  Show description for 78324b3
  pnunna93

  committed
  78324b3

  Copy full SHA for 78324b3

• Add rocm_version env var

  pnunna93

  committed
  c146b8b

  Copy full SHA for c146b8b

• Merge remote-tracking branch 'upstream/multi-backend-refactor' into enable_rocm_whls

  pnunna93

  committed
  953a383

  Copy full SHA for 953a383

Commits on Jul 30, 2024

• Remove thrush header files

  pnunna93

  committed
  d6c3df4

  Copy full SHA for d6c3df4

• Print node info

  pnunna93

  committed
  7e9a65c

  Copy full SHA for 7e9a65c

• print cuda node info

  pnunna93

  committed
  cdb209a

  Copy full SHA for cdb209a

• Revert "print cuda node info"

  Show description for 77e1499
  pnunna93

  committed
  77e1499

  Copy full SHA for 77e1499

• Revert "Print node info"

  Show description for 7c91909
  pnunna93

  committed
  7c91909

  Copy full SHA for 7c91909

• Add rocm arch to compile command

  pnunna93

  committed
  b78b340

  Copy full SHA for b78b340

• Rename .so files to rocm

  pnunna93

  committed
  a62b9d4

  Copy full SHA for a62b9d4

• Update default gpu arch

  pnunna93

  committed
  9059bff

  Copy full SHA for 9059bff

• Skip cpu based igemmlt int tests on ROCm

  pnunna93

  committed
  c5a406a

  Copy full SHA for c5a406a

• Update Documentation

  pnunna93

  committed
  9cbb5e1

  Copy full SHA for 9cbb5e1

• Update upstream repo name

  pnunna93

  committed
  3580624

  Copy full SHA for 3580624

• Update docs

  pnunna93

  committed
  3bde1b7

  Copy full SHA for 3bde1b7