Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The issue of referring results inconsitency #1

Open
liuyang-ict opened this issue Feb 8, 2025 · 4 comments
Open

The issue of referring results inconsitency #1

liuyang-ict opened this issue Feb 8, 2025 · 4 comments

Comments

@liuyang-ict
Copy link

Thanks for your very impressive work for OVD. However, there is an inconsistent issue in the REC results of MM-GroundingDINO between Table 5 and the original paper (e.g. 66.0 top-1 precision of refcoco-val in Table 5, but 53.* top-1 precision in the original paper of Table 5). Are there any typos here?

@fushh
Copy link
Collaborator

fushh commented Feb 8, 2025

Thanks for your interest.
As elaborated in Section C of Appendix, we have improved the inference pipeline of REC tasks due to task discrepancy. Thus, the performance in our Table 5 is higher than the one in the original paper.

@liuyang-ict
Copy link
Author

wow, that's a nice idea. May I inquire if it is possible to share the refined validation files of the REC?

@fushh
Copy link
Collaborator

fushh commented Feb 10, 2025

please see mmdet/models/detectors/grounding_dino.py

@liuyang-ict
Copy link
Author

I see. Thanks for your timely reply~~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants