rsx: Fixes

[kd-11]

• Largely implements remaining stuff to support vertex texture fetch properly.
• Cleanup: Remove fragment op register lookups from vertex textures as they have no meaning.
• Fixes NieR (Gestalt, USA ver.) - Popola and Devola are invisible ~ Boss fight only #4837

NOTE: Bumps shader cache version

[Xcedf]

Fixes "WCB failing" regression in Uncharted 1 chapter 4

[MarioSonic2987]

GTA V regressed. It doesn't show anything ingame.

Before:

After:

[kd-11]

Attach traces. Renderdoc trace if rrc capture does not work.

[kd-11]

I see the problem, but I cannot recreate the steps that get there. Is it possible to grab an RRC capture? That would help replay the setup.

[MarioSonic2987]

No. It takes too much time to do that.

[kd-11]

That is unfortunate. Without any way of recreating this becomes near impossible to debug. Marking as WIP, maybe some other game will hit the same problem.

[Kravickas]

gta v from vulkan rsx capture
https://send.firefox.com/download/10b69cdba2/#2JGTErnhf_Tp5thqFyxIbg

[kd-11]

Should be fixed now. Retest for other possible regressions.

[MarioSonic2987]

GTA V's regression is fixed.

[ZeeWanderer]

This pr broke text in Resistance 3 [BCES01118]
master:

pr:

dropbox->capture_pr.rar
RPCS3.log.gz
RPCS3_pr.log.gz
config used:
dropbox->config.yml

EDIT: as of 391aef4 the issue is fixed

[kd-11]

Retest, should be fixed now.

[Zangetsu38]

Yes, good is fixed

[Asinin3]

F1 Race Stars doesn't want to go ingame with this PR if I use OpenGL + Write Color Buffers it just crashes RPCS3. Checked other games with OpenGL+WCB and they were fine. Vulkan works fine with WCB on this game too. RPCS3.zip
WCB doesn't actually fix any graphical issues with this game, but it's still a regression. Maybe there is some other games that were affected.

Otherwise I checked around ~20 games with OGL+Vulkan and didn't notice any other issues from this PR.

[kd-11]

I checked F1, I can also trigger the crash on master. Its mechanism of failure is also unrelated (section leak between surface and texture caches) and Vulkan manages to get by because of luck. Fairly simple to fix, but that falls outside the scope of this PR.

[Asinin3]

Ahh, sorry. I did check master but it only crashed on the PR :/ race conditions are fun.

[spyropt]

Dark souls II infinite shader compilation 20s ingame 9000+++
RPCS3.log.gz

[Asinin3]

@spyropt Is it okay in the async PR? if it is i don't think there's much to worry about.

[spyropt]

@Asinin3 in the async pr it's ok but its missing the portrait on character selection

[kd-11]

Just press back or restart after reaching portraits or disable async if you really need the portraits. If you go back to the menu the shaders will have compiled and portraits will render fine.