Adds denoising_end parameter to ControlNetPipeline for SDXL

[UmerHA]

What does this PR do?

Adds denoising_end parameter to ControlNetPipeline for SDXL.

Fixes #6159 Edit: Removed changes to ControlNetXS, so does not fix #6159 yet.

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?
• Was this discussed/approved via a GitHub issue or the forum? Please add a link to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

Core library:

• Pipelines: @patrickvonplaten and @sayakpaul

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[sayakpaul]

Thank you! Do we need to add any "# Copied from ..." statements?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[sayakpaul]

@UmerHA do you want to revive this PR?

[UmerHA]

@sayakpaul Yes, I'll do it after I'm done with the new ControlNetXS PR, which should be ~next week.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[yiyixuxu]

@UmerHA
Can we only apply change for Controlnet pipeline in this PR, and get it merged now?
we have #6772 going on for controlnet XS that kinda races with this PR, no?

[UmerHA]

@yiyixuxu Sure - will get it done on Monday!

[UmerHA]

@yiyixuxu Have removed the ControlNetXS part - ready for review!

[yiyixuxu]

thanks!

[yiyixuxu]

also cc @stevhliu here for awareness
not sure if it's worth mentioning on the doc but now we can use controlnet SDXL pipeline together with the refiner

[sayakpaul]

Thanks for working on this.

Should we also add a test for this as I imagine denoising_end is something the users will want to experiment with.

@yiyixuxu WDYT?

[stevhliu]

not sure if it's worth mentioning on the doc but now we can use controlnet SDXL pipeline together with the refiner

Sure, let's add a [!TIP] to this doc saying you can use StableDiffusionXLControlNetPipeline with refiner checkpoints.

[yiyixuxu]

@UmerHA
do you want to add a test and a tip to the doc?
we can merge soon:)

[UmerHA]

@yiyixuxu - sure done!

I've copied & adapted the fast test for mixture of denoisers from SDXL. I've left the slow tests out on purpose because mixture of denoisers for ControlNet uses the same code as SDXL and SDXL already has slow tests.

[stevhliu]

A few minor nits, but otherwise LGTM!

[yiyixuxu]

thank you:)