Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Ascend NPU] Improve torchbenchmark results #42

Open
shink opened this issue Jan 26, 2025 · 0 comments
Open

[Ascend NPU] Improve torchbenchmark results #42

shink opened this issue Jan 26, 2025 · 0 comments
Assignees

Comments

@shink
Copy link
Contributor

shink commented Jan 26, 2025

Some benchmarks failed on NPU, there are still something we can do to improve them.

Torchbenchmark issues tracker

CV models

  • vision_maskrcnn

Installtation problems

  • fastNLP_Bert
  • opacus_cifar10 (Network problem)
  • torch_multimodal_clip (Network problem)

OOM

  • llava
NPU out of memory. Tried to allocate 174.00 MiB (NPU 0; 29.50 GiB total capacity; 28.26 GiB already allocated; 28.26 GiB current active; 34.72 MiB free; 29.10 GiB reserved in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation.

Runtime Error

  • sam_fast: No module named 'triton'
  • timm_efficientdet: not_implemented
  • simple_gpt: not_implemented
  • simple_gpt_tp_manual: not_implemented
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant