Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QNN EP] Increase tolerance for ReduceProd test on x64 Windows #17078

Merged
merged 3 commits into from
Aug 9, 2023

Conversation

adrianlizarraga
Copy link
Contributor

@adrianlizarraga adrianlizarraga commented Aug 9, 2023

Description

Slightly increases the allowable error tolerance for ReduceProd tests on x64 Windows/Linux with the QNN CPU backend.

Motivation and Context

A recent PR updated the input range for ReduceProd tests, which uncovered an inaccuracy for ReduceProd on x64 Windows/Linux with the QNN CPU backend. This PR updates the allowable error tolerance and adds a TODO for investigation.

This is needed to ensure the QNN_Nuget_Windows pipeline runs successfully.

@adrianlizarraga adrianlizarraga marked this pull request as ready for review August 9, 2023 17:14
HectorSVC
HectorSVC previously approved these changes Aug 9, 2023
Copy link
Contributor

@HectorSVC HectorSVC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

@adrianlizarraga
Copy link
Contributor Author

adrianlizarraga commented Aug 9, 2023

@HectorSVC Apparently this also happens on Linux x64. We didn't see it before because we were using "random" inputs, and the random inputs were different for Linux and Windows. Now that I added a test with fixed inputs, we see the inaccuracy for both Linux and Windows x64.

@adrianlizarraga adrianlizarraga merged commit d793e23 into main Aug 9, 2023
@adrianlizarraga adrianlizarraga deleted the adrianl/qnn-fix-cpu-reduce-op-tests branch August 9, 2023 20:52
jchen351 pushed a commit that referenced this pull request Aug 12, 2023
### Description
Slightly increases the allowable error tolerance for ReduceProd tests on
x64 Windows/Linux with the QNN CPU backend.


### Motivation and Context
A recent [PR](#16916)
updated the input range for ReduceProd tests, which uncovered an
inaccuracy for ReduceProd on x64 Windows/Linux with the QNN CPU backend.
This PR updates the allowable error tolerance and adds a TODO for
investigation.

This is needed to ensure the QNN_Nuget_Windows pipeline runs
successfully.
kleiti pushed a commit to kleiti/onnxruntime that referenced this pull request Mar 22, 2024
…soft#17078)

### Description
Slightly increases the allowable error tolerance for ReduceProd tests on
x64 Windows/Linux with the QNN CPU backend.


### Motivation and Context
A recent [PR](microsoft#16916)
updated the input range for ReduceProd tests, which uncovered an
inaccuracy for ReduceProd on x64 Windows/Linux with the QNN CPU backend.
This PR updates the allowable error tolerance and adds a TODO for
investigation.

This is needed to ensure the QNN_Nuget_Windows pipeline runs
successfully.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants