Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Display warning for unknown quants config instead of an error #35963

Merged
merged 10 commits into from
Feb 4, 2025

Conversation

SunMarc
Copy link
Member

@SunMarc SunMarc commented Jan 29, 2025

What does this PR do?

This PR changes how we deal with unknown quantization config. Instead of raising an error, we just skip the quantization logic and display a warning. Partially fixes #35471

@SunMarc SunMarc requested a review from MekkCyber January 29, 2025 16:34
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@MekkCyber
Copy link
Contributor

Thanks for the fix ! Looks good !

Copy link
Collaborator

@ArthurZucker ArthurZucker left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a test specifically that has an unsupported config? 🤠

@SunMarc SunMarc requested a review from ArthurZucker February 4, 2025 10:42
@SunMarc SunMarc merged commit 9f486ba into main Feb 4, 2025
26 checks passed
@SunMarc SunMarc deleted the relax-unknown-quants branch February 4, 2025 14:17
@ruidazeng
Copy link

@SunMarc How does this new fix interact with #36026

@SunMarc
Copy link
Member Author

SunMarc commented Feb 4, 2025

It is not related to #36026. It ignores the quantization_config when it is not recognized. Check my latest comment.

elvircrn pushed a commit to elvircrn/transformers that referenced this pull request Feb 13, 2025
…gface#35963)

* add supports_quant_method check

* fix

* add test and fix suggestions

* change logic slightly

---------

Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com>
sbucaille pushed a commit to sbucaille/transformers that referenced this pull request Feb 16, 2025
…gface#35963)

* add supports_quant_method check

* fix

* add test and fix suggestions

* change logic slightly

---------

Co-authored-by: Mohamed Mekkouri <93391238+MekkCyber@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Unknown quantization type, got fp8
6 participants