Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What prompts can I use for layout-aware t2i generation #8

Open
carvychen opened this issue Jul 12, 2023 · 3 comments
Open

What prompts can I use for layout-aware t2i generation #8

carvychen opened this issue Jul 12, 2023 · 3 comments

Comments

@carvychen
Copy link

What prompts can I use for layout-aware t2i generation to reproduce the same result in your paper?

@zyxElsa
Copy link
Owner

zyxElsa commented Jul 13, 2023

Layouts are generated in the early stages of generation, corresponding to lower-numbered prompt.
Please try to add the token embedding of the input image in the 1st, 2nd and 3rd prompt position
e.g.

prospect_words = ['strawberry cup cakes',  # 10 generation ends\ 
                       'strawberry cup cakes',  # 9 \
                       'strawberry cup cakes',  # 8 \
                       'strawberry cup cakes',  # 7 \ 
                       'strawberry cup cakes',  # 6 \ 
                       'strawberry cup cakes',  # 5 \
                       'strawberry cup cakes',  # 4 \
                       'strawberry cup cakes',  # 3 \
                       '*',  # 2 \
                       '*',  # 1 generation starts\ 
                      ], \

@zyxElsa
Copy link
Owner

zyxElsa commented Jul 13, 2023

and thanks for your question, I have also improved the README:)

@AnkitSinha123
Copy link

Can you let me know the approach for , when I have two different inversion and want to make it layout aware , material aware by mixing two prompts ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants