New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluate mse aligned multilingual clip #69

Open

rom1504 opened this issue Jan 20, 2023 · 2 comments

Labels

Contributor

rom1504 commented Jan 20, 2023

https://github.com/FreddeFrallan/Multilingual-CLIP

should be possible to add it simularly to https://github.com/LAION-AI/CLIP_benchmark/blob/main/clip_benchmark/models/japanese_clip.py

do you want to give it a try @FreddeFrallan ?

I'm still quite curious on how mse aligned mclip compared with the contrastive one

Contributor

FreddeFrallan commented Jan 20, 2023

I'm on it!

rom1504 added the new model label

Contributor Author

rom1504 commented Feb 18, 2023

So results were interestingly quite poor

The mystery of multilingual gap in imagenet top1 zero shot remains

Probably error analysis per class would help

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment