Code

BitsandBytes Enablement on ROCm#1207

Code

Merged

Titus-von-Koeller merged 132 commits intobitsandbytes-foundation:multi-backend-refactorbitsandbytes-foundation/bitsandbytes:multi-backend-refactorfrom ROCm:device_abstractionROCm/bitsandbytes:device_abstractionCopy head branch name to clipboardMay 24, 2024

+6,028-54

Commits

Commits on Jul 7, 2023

• hipify the csrc repo

  Lzy17

  committed
  2e10f67

  Copy full SHA for 2e10f67

Commits on Jul 9, 2023

• hipify pythoninterface

  Lzy17

  committed
  1928960

  Copy full SHA for 1928960

• copy from agrocylo

  Lzy17

  committed
  8ca0b5c

  Copy full SHA for 8ca0b5c

• hipify cuparse and cublas calls

  Lzy17

  committed
  8acbcf2

  Copy full SHA for 8acbcf2

Commits on Jul 10, 2023

• fix compile error and Makefile

  Lzy17

  committed
  e80a60c

  Copy full SHA for e80a60c

Commits on Jul 12, 2023

• fixed runtime error (low accuracy)

  Lzy17

  committed
  fb780a0

  Copy full SHA for fb780a0

• FIX LOW ACCURACY

  Lzy17

  committed
  1048264

  Copy full SHA for 1048264

• Update README.md

  Lzy17

  authored
  c330020

  Copy full SHA for c330020

• add benchmarks

  Lzy17

  committed
  fcee2d6

  Copy full SHA for fcee2d6

Commits on Jul 18, 2023

• Update README.md

  Lzy17

  authored
  4c0ca08

  Copy full SHA for 4c0ca08

Commits on Oct 11, 2023

• First draft, getting error

  jpvillam-amd

  committed
  c798616

  Copy full SHA for c798616

Commits on Oct 19, 2023

• Small transform fix, still errors on igemm

  jpvillam-amd

  committed
  37045e5

  Copy full SHA for 37045e5

Commits on Nov 15, 2023

• create HIP_ENVIRONMENT variable

  pnunna93

  committed
  524fa57

  Copy full SHA for 524fa57

• Skip failing tests on rocm

  pnunna93

  committed
  d7f7a82

  Copy full SHA for d7f7a82

Commits on Nov 20, 2023

• Add default value for HIP_ENVIRONMENT

  pnunna93

  committed
  28b8056

  Copy full SHA for 28b8056

Commits on Nov 21, 2023

• Merge pull request #1 from ROCmSoftwarePlatform/skip_rocm_failing_tests

  Show description for 9dca4fa
  amathews-amd

  authored
  9dca4fa

  Copy full SHA for 9dca4fa

• skip failing triton tests on rocm

  pnunna93

  committed
  38c934e

  Copy full SHA for 38c934e

• Merge pull request #2 from ROCmSoftwarePlatform/skip_triton

  Show description for 71bf2df
  amathews-amd

  authored
  71bf2df

  Copy full SHA for 71bf2df

Commits on Jan 12, 2024

• Enable col to row transformation

  pnunna93

  committed
  657ca4b

  Copy full SHA for 657ca4b

• Add make functions for row to col transformation

  pnunna93

  committed
  a390e0c

  Copy full SHA for a390e0c

• Update get_transform_buffer for row to col in HIP

  pnunna93

  committed
  99ad6b5

  Copy full SHA for 99ad6b5

• Update igemmlt for col format

  pnunna93

  committed
  039b808

  Copy full SHA for 039b808

• Unskip test_igemmlt_int on ROCm

  pnunna93

  committed
  1a052ee

  Copy full SHA for 1a052ee

• Update igemmlt_int test for col inputs

  pnunna93

  committed
  b7ca5cf

  Copy full SHA for b7ca5cf

• Skip transpose igemmlt test on ROCm

  pnunna93

  committed
  a2cd90d

  Copy full SHA for a2cd90d

• Revert "Update igemmlt_int test for col inputs"

  Show description for 5b6c5ac
  pnunna93

  committed
  5b6c5ac

  Copy full SHA for 5b6c5ac

• Return nvidia_transform from transform for HIP

  pnunna93

  committed
  218bf66

  Copy full SHA for 218bf66

• Fix syntax error

  pnunna93

  committed
  8bb5c2f

  Copy full SHA for 8bb5c2f

Commits on Jan 16, 2024

• Add comment for shape change

  pnunna93

  authored
  eb2edf7

  Copy full SHA for eb2edf7

• Enable nvidia_transform tests

  pnunna93

  committed
  a38ea0f

  Copy full SHA for a38ea0f

• Merge branch 'fix_igemmlt_int' of https://github.com/pnunna93/bitsandbytes into fix_igemmlt_int

  pnunna93

  committed
  fbacd7a

  Copy full SHA for fbacd7a

• Enable igemmlt_half tests

  pnunna93

  committed
  67c383b

  Copy full SHA for 67c383b

• Revert col32 check in nvidia_transform test

  pnunna93

  committed
  42b860f

  Copy full SHA for 42b860f

Commits on Jan 17, 2024

• Merge pull request #3 from pnunna93/fix_igemmlt_int

  Show description for 7198d6b
  amathews-amd

  authored
  7198d6b

  Copy full SHA for 7198d6b

Commits on Jan 26, 2024

• Merge remote-tracking branch 'upstream/main' into IFU-master-2024-01-24

  pnunna93

  committed
  b1d484a

  Copy full SHA for b1d484a

• Update README.md

  Lzy17

  authored
  c36085d

  Copy full SHA for c36085d

• Update hip files with upstream changes

  pnunna93

  committed
  0e91e48

  Copy full SHA for 0e91e48

Commits on Jan 27, 2024

• Skip failing tests for now

  pnunna93

  committed
  1295d53

  Copy full SHA for 1295d53

Commits on Jan 30, 2024

• Merge pull request #4 from ROCm/IFU-master-2024-01-24

  Show description for 48b7fa9
  amathews-amd

  authored
  48b7fa9

  Copy full SHA for 48b7fa9

Commits on Feb 2, 2024

• ops.hip: adapt to enum naming changes in ROCm/hipBLASLt@95131d6 and ROCm/hipBLASLt@3aad0d8

  iiisak

  committed
  f1a0b8b

  Copy full SHA for f1a0b8b

Commits on Feb 6, 2024

• fix wmma api parity

  Lzy17

  committed
  a84c369

  Copy full SHA for a84c369

Commits on Feb 7, 2024

• hipify wmma datatype

  Lzy17

  committed
  b044010

  Copy full SHA for b044010

Commits on Feb 12, 2024

• Enable estimate quantile tests

  pnunna93

  committed
  7aa42be

  Copy full SHA for 7aa42be

Commits on Feb 13, 2024

• Merge pull request #5 from iiisak/rocm_enabled

  Show description for 85377e1
  pnunna93

  authored
  85377e1

  Copy full SHA for 85377e1

• Merge pull request #7 from ROCm/fix_estimate_quantiles

  Show description for ffb0c5d
  amathews-amd

  authored
  ffb0c5d

  Copy full SHA for ffb0c5d

Commits on Feb 19, 2024

• Merge pull request #6 from ROCm/rocwmma_merge

  Show description for 2b77380
  Lzy17

  authored
  2b77380

  Copy full SHA for 2b77380

Commits on Feb 20, 2024

• Enable transpose flag for row to col transform

  pnunna93

  committed
  fad7918

  Copy full SHA for fad7918

• Update descriptors for transpose flag

  pnunna93

  committed
  e3021ee

  Copy full SHA for e3021ee

• revert nvidia_transform to transform

  pnunna93

  committed
  8c3476f

  Copy full SHA for 8c3476f

• update changes

  

  U-AMD\zhaoyili

  authored and

  U-AMD\zhaoyili

  committed
  5e1b152

  Copy full SHA for 5e1b152

Commits on Feb 23, 2024

• Merge pull request #8 from ROCm/enable_transform_with_transpose

  Show description for 386e16c
  pnunna93

  authored
  386e16c

  Copy full SHA for 386e16c

• fixed minor mistakes

  

  U-AMD\zhaoyili

  authored and

  U-AMD\zhaoyili

  committed
  389bb7d

  Copy full SHA for 389bb7d

• Merge pull request #9 from ROCm/rocm_enabled_fix_bfloat16

  Show description for b6770bf
  pnunna93

  authored
  b6770bf

  Copy full SHA for b6770bf

Commits on Mar 6, 2024

• remove blocksize 64 on rocm

  pnunna93

  committed
  fa28828

  Copy full SHA for fa28828

• remove block size 64 and enable remaining tests

  pnunna93

  committed
  d86d24c

  Copy full SHA for d86d24c

• Fix cuda build errors

  pnunna93

  committed
  cf4a506

  Copy full SHA for cf4a506

Commits on Mar 12, 2024

• remove workspace in igemmlt

  pnunna93

  committed
  7077195

  Copy full SHA for 7077195

• Enabled igemmlt in matmul

  pnunna93

  committed
  ec32fc1

  Copy full SHA for ec32fc1

• Fix shape issue in transform function

  pnunna93

  committed
  4536b25

  Copy full SHA for 4536b25

• Enable igemmlt int8 output

  pnunna93

  committed
  66e34c1

  Copy full SHA for 66e34c1

• Add col format for extract outliers

  pnunna93

  committed
  7e5e223

  Copy full SHA for 7e5e223

• Enable dequant_mm

  pnunna93

  committed
  2e42adb

  Copy full SHA for 2e42adb

• Enable matmullt tests

  pnunna93

  committed
  e32d277

  Copy full SHA for e32d277

• Enabled linear_serialization tests

  pnunna93

  committed
  8206bd1

  Copy full SHA for 8206bd1

• fix error with dequant_mm change

  pnunna93

  committed
  973a9f8

  Copy full SHA for 973a9f8

• Enable extract outliers test

  pnunna93

  committed
  387a9b7

  Copy full SHA for 387a9b7

• Enable test overflow

  pnunna93

  committed
  93dfb51

  Copy full SHA for 93dfb51

• Skip overflow and linear serialization for now

  pnunna93

  committed
  90bbdc6

  Copy full SHA for 90bbdc6

• Merge pull request #10 from ROCm/remove_blocksize_64

  Show description for 9890d5d
  pnunna93

  authored
  9890d5d

  Copy full SHA for 9890d5d

• Merge pull request #11 from ROCm/fix_cuda_build_errs

  Show description for 1b6dd48
  pnunna93

  authored
  1b6dd48

  Copy full SHA for 1b6dd48

• Merge pull request #12 from ROCm/igemm_workspace

  Show description for fc9bf4d
  pnunna93

  authored
  fc9bf4d

  Copy full SHA for fc9bf4d

• Merge pull request #13 from ROCm/enable_matmul

  Show description for f30dc38
  pnunna93

  authored
  f30dc38

  Copy full SHA for f30dc38

Commits on Mar 18, 2024

• improve the gemv 4bit accuracy by forcing the hipcub to 32

  

  U-AMD\zhaoyili

  authored and

  U-AMD\zhaoyili

  committed
  3dc14e8

  Copy full SHA for 3dc14e8

Commits on Mar 19, 2024

• Merge pull request #14 from ROCm/fix_gemv_4bit

  Show description for f4ac9ac
  Lzy17

  authored
  f4ac9ac

  Copy full SHA for f4ac9ac

• Update skip comment

  pnunna93

  committed
  485ba8f

  Copy full SHA for 485ba8f

• Merge pull request #15 from ROCm/gemv_skip_comment

  Show description for a36bd1d
  pnunna93

  authored
  a36bd1d

  Copy full SHA for a36bd1d

Commits on Apr 4, 2024

• Merge remote-tracking branch 'upstream/main' into IFU-master-2024-03-28

  pnunna93

  committed
  a551c16

  Copy full SHA for a551c16

Commits on Apr 9, 2024

• update instructions

  

  U-AMD\zhaoyili

  authored and

  U-AMD\zhaoyili

  committed
  a267221

  Copy full SHA for a267221

• Merge pull request #19 from ROCm/updated_readme

  Show description for bcdcc0b
  amathews-amd

  authored
  bcdcc0b

  Copy full SHA for bcdcc0b

• Update README.md

  pnunna93

  committed
  ff33371

  Copy full SHA for ff33371

• Merge branch 'rocm_enabled' into IFU-master-2024-03-28

  pnunna93

  authored
  1157e73

  Copy full SHA for 1157e73

• fix PEP errors

  pnunna93

  committed
  702ca1a

  Copy full SHA for 702ca1a

• Fix typos

  pnunna93

  committed
  8c23dc0

  Copy full SHA for 8c23dc0

• Merge branch 'IFU-master-2024-03-28' of https://github.com/ROCm/bitsandbytes into IFU-master-2024-03-28

  pnunna93

  committed
  971f4b1

  Copy full SHA for 971f4b1

Commits on Apr 10, 2024

• Fix formatting in README file

  pnunna93

  authored
  4d6408a

  Copy full SHA for 4d6408a

Commits on Apr 18, 2024

• Update gpu arch setting

  pnunna93

  committed
  79cb554

  Copy full SHA for 79cb554

• Add ROCM_PATH variable

  pnunna93

  committed
  5c0414e

  Copy full SHA for 5c0414e

• Add HIP_VERSION variable

  pnunna93

  committed
  47795f5

  Copy full SHA for 47795f5

• Add BNB_HIP_VERSION variable

  pnunna93

  committed
  6d90452

  Copy full SHA for 6d90452

• Update supports igemmlt based on HIP version

  pnunna93

  committed
  049a2dc

  Copy full SHA for 049a2dc

• Skip failing tests based on HIP version

  pnunna93

  committed
  47a0bc3

  Copy full SHA for 47a0bc3

• pre-commit fixes

  pnunna93

  committed
  1b2a095

  Copy full SHA for 1b2a095

• Update README file

  pnunna93

  committed
  4515a21

  Copy full SHA for 4515a21

Commits on Apr 19, 2024

• Update default arch list

  pnunna93

  committed
  e7ef75f

  Copy full SHA for e7ef75f

• update readme

  pnunna93

  committed
  c0d244c

  Copy full SHA for c0d244c

• Merge pull request #17 from ROCm/IFU-master-2024-03-28

  Show description for c037a30
  lcskrishna

  authored
  c037a30

  Copy full SHA for c037a30

Commits on Apr 22, 2024

• Merge remote-tracking branch 'TD_BnB/multi-backend-refactor' into device_abstraction

  pnunna93

  committed
  73f4f05

  Copy full SHA for 73f4f05

• update igemmlt for hip

  pnunna93

  committed
  79652a5

  Copy full SHA for 79652a5

• Update mm_dequant for hip

  pnunna93

  committed
  aedfa8f

  Copy full SHA for aedfa8f

• Update transform function for hip

  pnunna93

  committed
  7835282

  Copy full SHA for 7835282

Commits on Apr 26, 2024

• adding arch detection for test_gemv_eye_4bit

  

  root

  committed
  60d7560

  Copy full SHA for 60d7560

Commits on Apr 29, 2024

• implement get_rocm_gpu_arch

  

  root

  committed
  cae33c3

  Copy full SHA for cae33c3

Commits on Apr 30, 2024

• fixing lint

  

  root

  committed
  da53f39

  Copy full SHA for da53f39

• fixing lint

  

  root

  committed
  ae4dcec

  Copy full SHA for ae4dcec

• correct lint error

  

  root

  committed
  21d5ff6

  Copy full SHA for 21d5ff6

• Merge pull request #21 from ROCm/rocm_enabled_arch_detect

  Show description for 5bada9b
  pnunna93

  authored
  5bada9b

  Copy full SHA for 5bada9b

Commits on May 6, 2024

• Merge branch 'rocm_enabled' into device_abstraction

  pnunna93

  committed
  01abfde

  Copy full SHA for 01abfde

• update extract_outliers, quantize_4bit, dequantize_4bit

  lcskrishna

  committed
  765bfc8

  Copy full SHA for 765bfc8

• minor fixes for extract_outliers

  lcskrishna

  committed
  d00c026

  Copy full SHA for d00c026

• update blocksizes for quantize and dequantize

  lcskrishna

  committed
  e5574bd

  Copy full SHA for e5574bd

Commits on May 7, 2024

• Merge branch 'rocm_enabled' of https://github.com/ROCm/bitsandbytes into cl/update-device-abs

  

  root

  committed
  a00bd1f

  Copy full SHA for a00bd1f

• update reg expression for detecting arch

  lcskrishna

  committed
  7ab3a05

  Copy full SHA for 7ab3a05

• linter updates

  lcskrishna

  committed
  9cd1d8c

  Copy full SHA for 9cd1d8c

• Merge branch 'device_abstraction' into cl/update-device-abs

  lcskrishna

  authored
  62f8ed9

  Copy full SHA for 62f8ed9

Commits on May 8, 2024

• Merge pull request #23 from ROCm/cl/update-device-abs

  Show description for d9e4803
  pnunna93

  authored
  d9e4803

  Copy full SHA for d9e4803

Commits on May 9, 2024

• Merge remote-tracking branch 'upstream/multi-backend-refactor' into dev_abs_IFU

  pnunna93

  committed
  2af8568

  Copy full SHA for 2af8568

• skip linear no igemmlt test

  pnunna93

  committed
  06f6b25

  Copy full SHA for 06f6b25

• Remove archive functional file

  pnunna93

  committed
  2359452

  Copy full SHA for 2359452

• Sync README with upstream

  pnunna93

  committed
  f76d6ab

  Copy full SHA for f76d6ab

• Remove bnb_accuracy file

  pnunna93

  committed
  576b62c

  Copy full SHA for 576b62c

• Remove cuda_setup

  pnunna93

  committed
  dfb531b

  Copy full SHA for dfb531b

• Remove test_delete_later.c

  pnunna93

  committed
  31b1cbc

  Copy full SHA for 31b1cbc

• Sync with upstream

  pnunna93

  committed
  ed77476

  Copy full SHA for ed77476

• Sync files with upstream

  pnunna93

  committed
  943c57a

  Copy full SHA for 943c57a

Commits on May 10, 2024

• Fix lint errors

  pnunna93

  committed
  71d1702

  Copy full SHA for 71d1702

• Exclude hip files from typo checks

  pnunna93

  committed
  6886bc8

  Copy full SHA for 6886bc8

• update ops.hip

  pnunna93

  committed
  0d445f4

  Copy full SHA for 0d445f4

• Merge pull request #27 from ROCm/dev_abs_IFU

  Show description for bc6d0b7
  lcskrishna

  authored
  bc6d0b7

  Copy full SHA for bc6d0b7

• Add install steps for ROCm

  pnunna93

  committed
  15c7f77

  Copy full SHA for 15c7f77

• Fix lint error

  pnunna93

  committed
  d62c835

  Copy full SHA for d62c835

• Merge pull request #28 from ROCm/dev_abs_add_install_steps

  Show description for 8aae7c9
  lcskrishna

  authored
  8aae7c9

  Copy full SHA for 8aae7c9

Commits on May 15, 2024

• Add comments for HIP changes

  pnunna93

  committed
  410f499

  Copy full SHA for 410f499