-
Notifications
You must be signed in to change notification settings - Fork 5.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Document sequential CPU offload method on Stable Diffusion pipeline #1024
Conversation
The documentation is not available anymore as the PR was closed or merged. |
src/diffusers/pipelines/stable_diffusion/pipeline_stable_diffusion.py
Outdated
Show resolved
Hide resolved
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Super nice PR thanks a lot !
If you want we could tweet about this - happy to promote something if you want (or tweet from our side)
@patrickvonplaten you folks from HF can tweet about this if you want, I think letting people know they can use Stable Diffusion on less powerful setups would be great. I don't have a Twitter though, and just knowing I helped democratize Stable Diffusion a bit further is enough for me. |
BTW, we're still missing this doc page: https://huggingface.co/docs/diffusers/using-diffusers/loading . Could be a nice opportunity to showcase the: from_pretrained(..., device_map="auto") if you want :-) Here also a related issue: (just in case, you're interested in contributing some more) |
@patrickvonplaten I'm all about contributing to diffusers and making the life of Stable Diffusion users easier, will try to work on that on the coming days. |
Super tweeted it out here: https://twitter.com/PatrickPlaten/status/1585678494763257861 |
@patrickvonplaten than you for that. Now even my mom can run it on my old gaming laptopts haha. |
…uggingface#1024) * document cpu offloading method * address review comments Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com> Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Changes:
StableDiffusionPipeline.enable_sequential_cpu_offload
@patrickvonplaten as discussed in #850 (comment) and here #850 (comment) , I've just documented the sequential CPU offloading feature for Stable Diffusion Pipelines.