Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Return raw anomaly maps as metadata #2217

Merged
merged 4 commits into from
Jun 2, 2023
Merged

Conversation

djdameln
Copy link
Contributor

@djdameln djdameln commented Jun 2, 2023

Summary

Fix for https://jira.devtools.intel.com/browse/CVS-112271

Colormap conversion was applied twice after a recent change on Geti side. This PR fixes this by removing the color conversion on OTX side and passing the raw anomaly map instead.

How to test

See details in JIRA ticket.

Checklist

  • I have added unit tests to cover my changes.​
  • I have added integration tests to cover my changes.​
  • I have added e2e tests for validation.
  • I have added the description of my changes into CHANGELOG in my target branch (e.g., CHANGELOG in develop).​
  • I have updated the documentation in my target branch accordingly (e.g., documentation in develop).
  • I have linked related issues.

License

  • I submit my code changes under the same Apache License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below).
# Copyright (C) 2023 Intel Corporation
# SPDX-License-Identifier: Apache-2.0

@djdameln djdameln requested a review from a team as a code owner June 2, 2023 07:12
@github-actions github-actions bot added the ALGO Any changes in OTX Algo Tasks implementation label Jun 2, 2023
@djdameln djdameln changed the title [FIX] CVS-112271 [FIX] Return raw anomaly maps as metadata Jun 2, 2023
@goodsong81 goodsong81 changed the title [FIX] Return raw anomaly maps as metadata Return raw anomaly maps as metadata Jun 2, 2023
@github-actions github-actions bot added the DOC Improvements or additions to documentation label Jun 2, 2023
samet-akcay
samet-akcay previously approved these changes Jun 2, 2023
Copy link
Contributor

@samet-akcay samet-akcay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @djdameln! Really appreciate your hard work chasing this bug!

goodsong81
goodsong81 previously approved these changes Jun 2, 2023
Copy link
Contributor

@goodsong81 goodsong81 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the fix.

@sungmanc
Copy link
Contributor

sungmanc commented Jun 2, 2023

What a nice fix ! BTW, "Colormap conversion was applied twice after a recent change on Geti side.", is this only affects to the sailency map part? or only anomaly tasks?

I'm just wondering about the side effect of Geti's change to OTX side.

@djdameln djdameln dismissed stale reviews from goodsong81 and samet-akcay via 323c307 June 2, 2023 09:07
@sovrasov
Copy link
Contributor

sovrasov commented Jun 2, 2023

What a nice fix ! BTW, "Colormap conversion was applied twice after a recent change on Geti side.", is this only affects to the sailency map part? or only anomaly tasks?

I'm just wondering about the side effect of Geti's change to OTX side.

Other tasks from OTX were modified earlier, that problem with anomaly is a result of miscommunication.

@codecov-commenter
Copy link

Codecov Report

Patch coverage has no change and project coverage change: -0.01 ⚠️

Comparison is base (469a767) 79.96% compared to head (323c307) 79.96%.

Additional details and impacted files
@@                Coverage Diff                 @@
##           releases/1.2.3    #2217      +/-   ##
==================================================
- Coverage           79.96%   79.96%   -0.01%     
==================================================
  Files                 459      459              
  Lines               33794    33790       -4     
==================================================
- Hits                27024    27020       -4     
  Misses               6770     6770              
Flag Coverage Δ
py310 79.96% <0.00%> (-0.01%) ⬇️
py38 ?
py39 ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...s/anomaly/adapters/anomalib/callbacks/inference.py 91.66% <ø> (-0.12%) ⬇️
otx/algorithms/anomaly/tasks/openvino.py 25.99% <0.00%> (-0.33%) ⬇️

... and 1 file with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@goodsong81 goodsong81 merged commit 3ae37de into releases/1.2.3 Jun 2, 2023
@goodsong81 goodsong81 deleted the da/fix-CVS-112271 branch June 2, 2023 12:06
goodsong81 pushed a commit that referenced this pull request Jun 2, 2023
* return raw anomaly map instead of colormap

* return raw heatmap in openvino inference

* Update changelog

* convert anomaly map to numpy
goodsong81 added a commit that referenced this pull request Jun 5, 2023
* Fix e2e (#2179)

* Fix iseg e2e (#2173)

* Fix det e2e (#2176)

* Update noisy label det docs for detection task (#2183)

* Fix iseg e2e (#2173)

* Fix det e2e (#2176)

* Add supcon seg for regression (#2177)

* Fix iseg e2e (#2173)

* Fix det e2e (#2176)

* Update regression test config (#2186)

* Fix for anomaly regression test (#2188)

* Fix iseg regression (#2190)

* Set path to save pseudo masks into workspace (#2185)

* Temporary fix override_configs bug (#2187)

* Fix iseg e2e (#2173)

* Fix det e2e (#2176)

* Cleaned up skip/xfail TCs on the classification e2e tests (#2196)

* Added csv output to export dependencies (#2178)

* Fix typo and enlarge the threshold for KPI tests (#2198)

* bugfix: auto adapt batch size doesn't work with cls incr case (#2199)

* Fix for ssd (#2197)

* Turn off persistent worker if num_worker is zero in classification task (#2208)

* Update test cases of common_semantic_segmentation_dataset (#2210)

* Optimize counting train & inference speed and memory consumption (#2172)

* Do not skip full img tile classifier + Fix Sequencial Export Issue (#2174)

* Add warning message to tiling parameter (#2193)

* Change the way to pad for instance-segmentation

* Hotfix: use 0 confidence threshold when computing best threshold based on F1

* Fix possible bw issue in exportable code (#2212)

* Fix ellipse load (#2214)

* Fix GT vs prediction order mismatch due to different sorting result (#2216)

* Return raw anomaly maps as metadata (#2217)

* Fix merge error, revert to pymongo w/o version spec

---------

Signed-off-by: Songki Choi <songki.choi@intel.com>
Signed-off-by: Kim, Vinnam <vinnam.kim@intel.com>
Co-authored-by: Jaeguk Hyun <jaeguk.hyun@intel.com>
Co-authored-by: Vinnam Kim <vinnam.kim@intel.com>
Co-authored-by: Sungman Cho <sungman.cho@intel.com>
Co-authored-by: Eunwoo Shin <eunwoo.shin@intel.com>
Co-authored-by: Kim, Sungchul <sungchul.kim@intel.com>
Co-authored-by: Yunchu Lee <yunchu.lee@intel.com>
Co-authored-by: Jihwan Eom <jihwan.eom@intel.com>
Co-authored-by: Eugene Liu <eugene.liu@intel.com>
Co-authored-by: sungmanc <sungmanc@intel.com>
Co-authored-by: Vladislav Sovrasov <sovrasov.vlad@gmail.com>
Co-authored-by: Dick Ameln <dick.ameln@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ALGO Any changes in OTX Algo Tasks implementation DOC Improvements or additions to documentation FIX defect fix HOTFIX RELEASE
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants