Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how to use the "Flow-Square-Mean" in Motion effects #2

Open
mamianshusheng opened this issue May 6, 2024 · 5 comments
Open

how to use the "Flow-Square-Mean" in Motion effects #2

mamianshusheng opened this issue May 6, 2024 · 5 comments

Comments

@mamianshusheng
Copy link

I can't find the function or any other files to use Flow-Square-Mean ?

@mamianshusheng
Copy link
Author

Did you open source this function? I can't find it in any of the files.

@fanfanda
Copy link
Collaborator

fanfanda commented May 6, 2024

Hi, thanks for your attention!

We obtain the evaluation code directly from https://github.com/princeton-vl/RAFT, and we have not integrated it into eval.py. We use the square average of the predicted values from adjacent frames to represent the motion dynamics of the video.

@mamianshusheng
Copy link
Author

Thank you for your reply. It's really nice of you.

@harelc
Copy link

harelc commented Jun 23, 2024

@fanfanda could you please provide more specifics about how you evaluated using RAFT, so that it can be used for evaluating other video generation models? which of their models did you use? Did you compute the mean of the square of the norm of the flow (MSE)? or "the square average" = the square of the mean of the norm? Did you normalize by anything (video resolution, number of frames etc)?

@mamianshusheng
Copy link
Author

mamianshusheng commented Jun 23, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants