Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_schema_meta_validation[maskrcnn_resnet50_fpn_v2] needs to be fixed #7349

Open
NicolasHug opened this issue Feb 27, 2023 · 0 comments
Open

Comments

@NicolasHug
Copy link
Member

This test is randomly failing:

Traceback (most recent call last):
  File "/home/circleci/project/test/test_extended_models.py", line 276, in test_schema_meta_validation
    assert not incorrect_meta
AssertionError: assert not [(MaskRCNN_ResNet50_FPN_V2_Weights.COCO_V1, '_ops')]

Due to this check:

calculated_ops = get_ops(model=model, weight=w, **kwargs)
if calculated_ops != w.meta["_ops"]:
incorrect_meta.append((w, "_ops"))

Turns out the get_ops() function is sensitive to the random seed which leads to different computed OPS and makes the test fail. I don't know if it's get_ops() who's wrong, or if there is something inherently buggy in MaskRCNN. Or if this is expected and we just need to set the random seed. IDK.

We have to skip this test for now to unblock the release, but we should go back to it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant