Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GEN-VLKT+CQL #7

Open
paihuai00 opened this issue Sep 13, 2023 · 4 comments
Open

GEN-VLKT+CQL #7

paihuai00 opened this issue Sep 13, 2023 · 4 comments

Comments

@paihuai00
Copy link

When applying the CQL method to GEN-VLKT, how should we handle the CLIP weight for verb classification?

Can you provide the relevant code?

@Charles-Xie
Copy link
Owner

When applying CQL to GEN-VLKT, we use CLIP weight to initialize the category queries. I will upload the code for this part after finishing a recent deadline 😃

@paihuai00
Copy link
Author

When applying CQL to GEN-VLKT, we use CLIP weight to initialize the category queries. I will upload the code for this part after finishing a recent deadline 😃

How's it going?

@xiguahong
Copy link

Thank you for your work. It has been three months. Can you release the code for GENVLKT+CQL now? I'm having trouble with its performance.

@kkayla99
Copy link

kkayla99 commented Nov 2, 2023

@Charles-Xie Hello, I would like to inquire whether the CLIP weight used to initialize the category queries is derived from the HOI triplet text or just from interaction text, and how? What is the coefficient for the image loss in GEN? Could you update some code examples?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants