Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document sequential CPU offload method on Stable Diffusion pipeline #1024

Merged
merged 4 commits into from
Oct 27, 2022

Conversation

piEsposito
Copy link
Contributor

Changes:

@patrickvonplaten as discussed in #850 (comment) and here #850 (comment) , I've just documented the sequential CPU offloading feature for Stable Diffusion Pipelines.

@piEsposito piEsposito changed the title Document CPU offload method on Stable Diffusion pipeline Document sequential CPU offload method on Stable Diffusion pipeline Oct 27, 2022
@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Oct 27, 2022

The documentation is not available anymore as the PR was closed or merged.

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Copy link
Contributor

@patrickvonplaten patrickvonplaten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Super nice PR thanks a lot !

If you want we could tweet about this - happy to promote something if you want (or tweet from our side)

@piEsposito
Copy link
Contributor Author

piEsposito commented Oct 27, 2022

@patrickvonplaten you folks from HF can tweet about this if you want, I think letting people know they can use Stable Diffusion on less powerful setups would be great.

I don't have a Twitter though, and just knowing I helped democratize Stable Diffusion a bit further is enough for me.

@patrickvonplaten patrickvonplaten merged commit de00c63 into huggingface:main Oct 27, 2022
@patrickvonplaten
Copy link
Contributor

BTW, we're still missing this doc page: https://huggingface.co/docs/diffusers/using-diffusers/loading . Could be a nice opportunity to showcase the:

from_pretrained(..., device_map="auto")

if you want :-)

Here also a related issue:
#968

(just in case, you're interested in contributing some more)

@piEsposito
Copy link
Contributor Author

BTW, we're still missing this doc page: https://huggingface.co/docs/diffusers/using-diffusers/loading . Could be a nice opportunity to showcase the:

from_pretrained(..., device_map="auto")

if you want :-)

Here also a related issue: #968

(just in case, you're interested in contributing some more)

@patrickvonplaten I'm all about contributing to diffusers and making the life of Stable Diffusion users easier, will try to work on that on the coming days.

@patrickvonplaten
Copy link
Contributor

Super tweeted it out here: https://twitter.com/PatrickPlaten/status/1585678494763257861

@piEsposito
Copy link
Contributor Author

@patrickvonplaten than you for that. Now even my mom can run it on my old gaming laptopts haha.

yoonseokjin pushed a commit to yoonseokjin/diffusers that referenced this pull request Dec 25, 2023
…uggingface#1024)

* document cpu offloading method

* address review comments

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants