Debug CI plot

[SkafteNicki]

What does this PR do?

Something happened to CI because windows has been failing since yesterday with segmentation faults during the plot testing.
https://github.com/Lightning-AI/torchmetrics/actions/runs/5447802124/jobs/9910639362
https://github.com/Lightning-AI/torchmetrics/actions/runs/5447246903/jobs/9909381752

Trying to debug here because cannot reproduce locally.

Before submitting

• Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure to update the docs?
• Did you write any new necessary tests?

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

---

📚 Documentation preview 📚: https://torchmetrics--1878.org.readthedocs.build/en/1878/

[codecov]

Codecov Report

Merging #1878 (07f6376) into master (13f85d0) will not change coverage.
The diff coverage is n/a.

Additional details and impacted files

@@          Coverage Diff           @@
##           master   #1878   +/-   ##
======================================
  Coverage      85%     85%           
======================================
  Files         260     260           
  Lines       14908   14908           
======================================
  Hits        12657   12657           
  Misses       2251    2251