Contrastive loss in the model

[fbao-fudan]

Dear authors,

Thanks for releasing the code. I noticed the manuscript mentioned you used contrastive loss in the model. Could you please point me to the position where to use it?
Thank you!

Feng

[vinid]

Hi!

Thanks for your interest!

The code in this repo cannot be used for training. What we have here is to do reproducibility studies.

A couple of starting points that might be useful to get into the contrastive loss:

• Training Code based on OriginalCLIP (this is the one we used for training)
• HF Training Pipeline
• OpenCLIP training pipeline (this is the one we recently started using for training, due to the fact that it's easier to scale to multi-GPU setups with this one)

Hope this is helpful!

[fbao-fudan]

Thank you! This is really helpful.