Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

taxonomy_clip_embeddings.pt missing #3

Closed
Tushar-N opened this issue Feb 22, 2023 · 1 comment
Closed

taxonomy_clip_embeddings.pt missing #3

Tushar-N opened this issue Feb 22, 2023 · 1 comment

Comments

@Tushar-N
Copy link

Could you point me to the script to generate taxonomy_clip_embeddings.pt? I can't find it in the repo.

@Evm7
Copy link
Owner

Evm7 commented Feb 26, 2023

taxonomy_clip_embeddings.pt is a dictionary that maps verbs and noun classes into their CLIP features. To generate this file, you can simply make use of CLIP text_encoder function for each verb and noun.
I have added the taxonomy_clip_embeddings file to the model.

However, this file was only used during the experiments, and it is not used in the final model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants