We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
transformers
@SunMarc and @younesbelkada
examples
from transformers import BitsAndBytesConfig cfg = BitsAndBytesConfig( load_in_4bit=True, bnb_4bit_quant_storage='add' )
Will not fail with a validation error and will just continue as-is
Failing with a ValueError, same as bnb_4bit_compute_dtype
bnb_4bit_compute_dtype
The text was updated successfully, but these errors were encountered:
Successfully merging a pull request may close this issue.
System Info
transformers
version: 4.41.1Who can help?
@SunMarc and @younesbelkada
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
Will not fail with a validation error and will just continue as-is
Expected behavior
Failing with a ValueError, same as
bnb_4bit_compute_dtype
The text was updated successfully, but these errors were encountered: