What attention_scale.py does and how it works?

[rezponze]

HI!! Thanks for Attention Couple, really useful!

Regarding Attention Scale, is it supposed to work with Attention Couple when doing a HiRes Fix pass?

If so, what do the values mean, and how it is wired?

[laksjdjf]

It is similar to UNetSelfAttentionMultiply or UNetCrossAttentionMultiply.

[rezponze]

I'm unfamiliar with those two nodes and my knowledge is not that deep. Tried googling but couldn't find much.
Would you mind explaining just a bit what they do?

[laksjdjf]

The model has a mechanism to investigate the correlation between each token of the prompt and each pixel of the image. By lowering the temperature, the correlation is adjusted to become stronger for only certain pixels. This was implemented with the expectation of making the model more faithful to the prompt.

The effect of attn1 is unclear.