Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stub out additional backends #1173

Conversation

matthewdouglas
Copy link
Member

Incremental progress for backend interface.

Creates empty stubs for additional backends: CPU, MPS, ROCm, XPU. The CPU backend is always registered, while CUDA/ROCm, MPS, and XPU are only registered when detected in the environment.

Moved some more from bnb.functional to be implemented by backends:

  • gemv_4bit
  • optimizer_update_8bit_blockwise
  • optimizer_update_32bit

Defined in backend interface, but not completely moved yet:

  • dequantize_blockwise
  • quantize_blockwise

Updated type hints.

stevhliu and others added 19 commits March 26, 2024 10:06
Bumps the minor-patch group with 1 update: [lion-pytorch](https://github.com/lucidrains/lion-pytorch).


Updates `lion-pytorch` from 0.1.2 to 0.1.4
- [Release notes](https://github.com/lucidrains/lion-pytorch/releases)
- [Commits](lucidrains/lion-pytorch@0.1.2...0.1.4)

---
updated-dependencies:
- dependency-name: lion-pytorch
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: minor-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…uant4bit-blocksize4096

Fix 4bit quantization with blocksize = 4096
Updates the requirements on [matplotlib](https://github.com/matplotlib/matplotlib) to permit the latest version.

Updates `matplotlib` to 3.8.4
- [Release notes](https://github.com/matplotlib/matplotlib/releases)
- [Commits](matplotlib/matplotlib@v3.8.3...v3.8.4)

---
updated-dependencies:
- dependency-name: matplotlib
  dependency-type: direct:development
  dependency-group: major
...

Signed-off-by: dependabot[bot] <support@github.com>
…uild-cu124

Add CUDA 12.4 to Linux x86-64 Build Workflow
…ndabot/pip/major-45b123642d

Update matplotlib requirement from ~=3.8.3 to ~=3.8.4 in the major group
* split build from source off

* validated compilers
…es-foundation#1170)

Bumps the minor-patch group with 1 update: [scipy](https://github.com/scipy/scipy).


Updates `scipy` from 1.12.0 to 1.13.0
- [Release notes](https://github.com/scipy/scipy/releases)
- [Commits](scipy/scipy@v1.12.0...v1.13.0)

---
updated-dependencies:
- dependency-name: scipy
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…s-foundation#1164)

* change 8-bit serialization weight format format

* precimmit

* pre-commit

* fix

* Update bitsandbytes/nn/modules.py

Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update bitsandbytes/nn/modules.py

Co-authored-by: Aarni Koskela <akx@iki.fi>

* Update bitsandbytes/utils.py

Co-authored-by: Aarni Koskela <akx@iki.fi>

* address feedback

* lint

---------

Co-authored-by: Aarni Koskela <akx@iki.fi>
Copy link

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

dependabot bot and others added 2 commits April 17, 2024 09:53
…itsandbytes-foundation#1182)

Updates the requirements on [pandas](https://github.com/pandas-dev/pandas) to permit the latest version.

Updates `pandas` to 2.2.2
- [Release notes](https://github.com/pandas-dev/pandas/releases)
- [Commits](pandas-dev/pandas@v2.2.1...v2.2.2)

---
updated-dependencies:
- dependency-name: pandas
  dependency-type: direct:development
  dependency-group: major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…es-foundation#1183)

* (docs) integrations: fix omission in bf16 related warning

* (docs) integrations: further clarifications to prior fix

* (docs) integrations: fix punctuation

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* (docs) integrations: fix omitted code formatting

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
@Titus-von-Koeller
Copy link
Collaborator

Hey!

I am taking the week off to rest up a bit. I'll be back next Monday and this is at the very top of my list.

dependabot bot and others added 2 commits April 30, 2024 18:29
Bumps the minor-patch group with 2 updates: [pytest](https://github.com/pytest-dev/pytest) and [einops](https://github.com/arogozhnikov/einops).


Updates `pytest` from 8.1.1 to 8.2.0
- [Release notes](https://github.com/pytest-dev/pytest/releases)
- [Changelog](https://github.com/pytest-dev/pytest/blob/main/CHANGELOG.rst)
- [Commits](pytest-dev/pytest@8.1.1...8.2.0)

Updates `einops` from 0.7.0 to 0.8.0
- [Release notes](https://github.com/arogozhnikov/einops/releases)
- [Commits](arogozhnikov/einops@v0.7.0...v0.8.0)

---
updated-dependencies:
- dependency-name: pytest
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-patch
- dependency-name: einops
  dependency-type: direct:production
  update-type: version-update:semver-minor
  dependency-group: minor-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@Titus-von-Koeller Titus-von-Koeller merged commit 749e06f into bitsandbytes-foundation:multi-backend-refactor May 6, 2024
1 of 2 checks passed
@Titus-von-Koeller
Copy link
Collaborator

Thanks @matthewdouglas, this was a really helpful iterative next step. Really appreciated ❤️

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants