-
Notifications
You must be signed in to change notification settings - Fork 120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add support whisper for openvino #470
Conversation
@AlexKoff88 @echarlaix @helena-intel could you please take a look? |
bbc39bd
to
f73f469
Compare
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. |
@echarlaix I pin transformers<4.35 version as workaround for incompatibility issues to be able pass ci checks (removing SSDP, refactoring models that lead to previously used patching approach does not work anymore for llama, opt, and other models). |
d66bb87
to
169e11c
Compare
@echarlaix @helena-intel could we prioritize this PR? We need it very much. It will simplify using OpenVINO for Whisper a lot :) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
very nice PR @eaidova, thanks!
@echarlaix looks like transformers 4.36 break some model export, including whisper support. I added workaround similar to huggingface/optimum#1590, please take a look |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks great 🔥 , thanks a lot for the addition @eaidova
What does this PR do?
Adding support for inference whisper models family with openvino.
Verified on distil-whisper-large-v2
Before submitting