Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ImagenHub Integration #9

Open
vinesmsuic opened this issue Oct 29, 2024 · 3 comments
Open

ImagenHub Integration #9

vinesmsuic opened this issue Oct 29, 2024 · 3 comments

Comments

@vinesmsuic
Copy link

vinesmsuic commented Oct 29, 2024

Very cool work!

We added the implementation of AURORA on ImagenHub (ICLR 2024). Feel free to checkout the results on our ImagenHub visualization and verify the code implementation :)

Visualization: https://chromaica.github.io/Museum/ImagenHub_Text-Guided_IE/
Code integration: TIGER-AI-Lab/ImagenHub#35
Best,
Max

@BennoKrojer
Copy link
Collaborator

Hi Max,

That's awesome! Great community effort from your end to unify everything so nicely. Out of curiosity, how many of the prompts are "in favor" of where AURORA shines (shines is maybe a strong word since these edits are very hard but let's say "doesn't fail 99% of the time") which is spatial and action editing?

Best,
Benno

@BennoKrojer
Copy link
Collaborator

As a suggestion, you could integrate some of the examples from AURORA Bench that would make it more diverse in terms of skills/reasoning? They are all easily available on the github here: https://github.com/McGill-NLP/AURORA/blob/main/test.json

@BennoKrojer
Copy link
Collaborator

image Here you can quickly see which tasks cover skills that were previously not much covered (AG, Something Something, Epic Kitchen, WhatsUp, CLEVRER, Kubric). Some might be too niche for your purpose but AG, Something Something and WhatsUp are quite general skills you would want from an editing model

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants