loss m_mse of MDT-S-2 is much larger than mse and the visualization of MDT-S-2 with mask_ratio 0.3 does not work

[ZGCTroy]

From the loss of mse and m_mse, it seems that the mask branch does not work in MDT-S-2. We also visualize the generation image and find that generated image with mask_ratio=None is normal but the image with mask_ratio=0.3 is noise.

[gasvn]

This is expected, as we want to keep the standard diffusion process and thus make the side-interpolater very small. If you want to rely on the side-interpolater for inference, it's required to make the side-interpolater larger.

[ghost]

@gasvn
Hello! Thank you for your excellent work!
How should I make the side-interpolater larger in MDT-S-2 correctly?
Do you mean redesigning the side-interpolater to make its network layers larger? As mentioned in your paper，

“When the side-interpolater is kept during inference, MDT naturally enables the image inpainting ability.”

How to carry out specific design?