Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reconstruct final videos? #7

Open
McGregorWwww opened this issue Jan 12, 2025 · 7 comments
Open

How to reconstruct final videos? #7

McGregorWwww opened this issue Jan 12, 2025 · 7 comments

Comments

@McGregorWwww
Copy link

Thank you for your inspiring work!
I've obtained the reconstructed blurry video and keyframes; how can I reconstruct the final videos? The scripts.neuroclips file seems missing, and the scripts.animate file does not take the four generated .pt files as inputs. Looking forward to your response.

@LemonTwoL
Copy link

Thank you for your inspiring work! I've obtained the reconstructed blurry video and keyframes; how can I reconstruct the final videos? The scripts.neuroclips file seems missing, and the scripts.animate file does not take the four generated .pt files as inputs. Looking forward to your response.

hello, can you reproduce the results? I also cannot find scripts.neuroclips.

@McGregorWwww
Copy link
Author

Thank you for your inspiring work! I've obtained the reconstructed blurry video and keyframes; how can I reconstruct the final videos? The scripts.neuroclips file seems missing, and the scripts.animate file does not take the four generated .pt files as inputs. Looking forward to your response.

hello, can you reproduce the results? I also cannot find scripts.neuroclips.

After modifying script.animate, it can generate videos, but the results are lower than those reported in the paper.

@ChenLiu-1996
Copy link

ChenLiu-1996 commented Jan 30, 2025

Hi @McGregorWwww do you mind if I ask how you modified Animatediff.script.animate? I cleaned up the code all the way to this final stage but I got a bit stuck here.

Hi @gongzix first of all the reported results look great and thanks for releasing the code. It appears that you might not have included the Animatediff.script.neuroclips in the uploaded code. If that is the case can you help include that? Also, is the Readme correctly reflecting the steps for the final stage of reconstructing the high-quality video? I have done all previous four steps but is stuck at the final stage. Thanks!

@gongzix
Copy link
Owner

gongzix commented Jan 31, 2025

It seems that it was not synchronized before, and I have added the neuroclip.py file.

@ChenLiu-1996
Copy link

@gongzix Thank you so much! I will try that out.

@Alisaleelee
Copy link

Alisaleelee commented Feb 5, 2025

@gongzix Thank you so much! I will try that out.

hello, I'm not sure if the keyframes you generated are correct. I trained them using the default parameters provided by the author, but I feel that most of the keyframes are incorrect. Here are the first four keyframes I obtained:

Image
Image
Image
Image

@junpan19-new
Copy link

@gongzix Thank you so much! I will try that out.

hello, I'm not sure if the keyframes you generated are correct. I trained them using the default parameters provided by the author, but I feel that most of the keyframes are incorrect. Here are the first four keyframes I obtained:

Image Image Image Image

same issues!!!!!!!!!!!!!!!!!!!! I can not reproduce the key frame results as shown in the paper.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants