Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CANN: cann backend build failed when manually specify SOC_TYPE or gcc version that isn't verified #10519

Merged
merged 3 commits into from
Nov 28, 2024
Merged

CANN: cann backend build failed when manually specify SOC_TYPE or gcc version that isn't verified #10519

merged 3 commits into from
Nov 28, 2024
+57 −9

Conversation

leo-pony
Copy link
Contributor

  1. Manual specify SOC_TYPE
  2. Under some unusual compile environment

Corresponding issue is #10517

@leo-pony
Copy link
Contributor Author

This PR has verified on Ascend910B3 and Ascend310P3, as following:
image
image

@github-actions github-actions bot added documentation Improvements or additions to documentation ggml changes relating to the ggml tensor library for machine learning labels Nov 26, 2024
@leo-pony leo-pony marked this pull request as draft November 27, 2024 01:20
@leo-pony leo-pony marked this pull request as ready for review November 28, 2024 01:17
@leo-pony leo-pony mentioned this pull request Nov 28, 2024
Closed
@hipudding hipudding added the Ascend NPU issues specific to Ascend NPUs label Nov 28, 2024
@hipudding hipudding self-requested a review November 28, 2024 06:17
@leo-pony leo-pony mentioned this pull request Nov 28, 2024
Closed
@hipudding hipudding merged commit 605fa66 into ggerganov:master Nov 28, 2024
50 checks passed
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Dec 20, 2024
@leo-pony @arthw
CANN: Fix SOC_TYPE compile bug (ggerganov#10519)
a45d576 
* CANN: Fix the bug build fail on Ascend310P under two cases:
1) Manual specify SOC_TYPE
2) Under some unusual compile environment

* Update the cann backend News content: Support F16 and F32 data type model for Ascend 310P NPU.

* fix CANN  compile fail bug: the assert in ascend kernel function doesn't supportted on some CANN version
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hipudding hipudding hipudding approved these changes

Assignees

@leo-pony leo-pony

Labels
Ascend NPU issues specific to Ascend NPUs documentation Improvements or additions to documentation ggml changes relating to the ggml tensor library for machine learning
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@leo-pony @hipudding