-
Notifications
You must be signed in to change notification settings - Fork 22
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Browse files
Browse the repository at this point in the history
make filename correctly ordered add RIFE for cond interp add skip_fuse add reset cuda button
- Loading branch information
Showing
4 changed files
with
315 additions
and
406 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,34 @@ | ||
# stable-diffusion-webui-non-prompt-travel (extensions) | ||
|
||
Of course not only prompts! -- You shall also be able to travel through any other conditions. 😀 | ||
|
||
---- | ||
|
||
### ControlNet-Travel | ||
|
||
Travel through ControlNet's control conditions like canny, depth, openpose, etc... | ||
|
||
⚠ Memory (not VRAM) usage grows linearly with sampling steps, and fusion layers count, this is its nature 😥 | ||
|
||
Quickstart instructions: | ||
|
||
- prepare a folder of images, might be frames from a video | ||
- check enble `sd-webui-controlnet`, set all parameters as you want, but it's ok to **leave the ref image box empty** | ||
- reference images will be read from the image folder given in controlnet-travel :) | ||
- find `ControlNet Travel` in the script dropdown, set all parameters again, specify your image folder path here | ||
- click Generate button | ||
|
||
Options: | ||
|
||
- interp_meth: (categorical) | ||
- `linear`: linear weighted sum, better for area-based annotaions like `depth`, `seg` | ||
- `rife`: optical flow model (requires to install postprocess tools first), better for edge-base annotaions like `canny`, `openpose` | ||
- skip_latent_fusion: (list of bool), experimental | ||
- skip some latent layers fusion for saving memory, but might get wierd results 🤔 | ||
- ℹ the `mid` and `out` blocks are safe to skip in my experiences | ||
- save_rife: (bool), save the rife interpolated condtion images | ||
|
||
|
||
---- | ||
by Armit | ||
2023/04/12 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.