Topic: How to configure Rife Ai for character motion

I have been using upto date rife ai with the latest model as it's released with svp updates. But can't really tell any difference from automatic at 60fps. The Ai model is definitely working, it makes my gpu hot.62°c (4080)
Cpu is i9 10980XE. 32gb ram.

I want my anine to look like this demo

https://github.com/hzwer/Practical-RIFE/pull/23

What settings do I need to use or model would help me get this desired result? Would I need to transcode the episodes or can it be done in real time? Also yes, panning looks great, no complaints there.

Any help is greatly appreciated!

2 Reply by flowreen91 (edited by flowreen91 15-05-2024 20:25:17)

  • Thanks: 74

Re: How to configure Rife Ai for character motion

Hatsune Miku wrote:

I want my anine to look like this demo

Are you talking about the Duplicate frames removal -> Remove every other frame button?
https://gyazo.com/1b3268d58ebe2e0a1ba9c5ce13499192
Your PC must be a real potato to be forced to slash half of all the frames in order to watch half an anime.

3 Reply by Hatsune Miku (edited by Hatsune Miku 16-05-2024 00:36:42)

Re: How to configure Rife Ai for character motion

flowreen91 wrote:
Hatsune Miku wrote:

I want my anine to look like this demo

Are you talking about the Duplicate frames removal -> Remove every other frame button?
https://gyazo.com/1b3268d58ebe2e0a1ba9c5ce13499192
Your PC must be a real potato to be forced to slash half of all the frames in order to watch half an anime.

Maybe I was over estimating the power of rife ai.

I have never used the remove dublicate frame option. With out any examples, the best way to say it is I want all the characters to move like they do in RWBY. Ie: 3d animated with out the 3d part.

I've seen so many demos of rife ai making 8fps gifs look smooth. I figured it could do that to anime since the characters still move at like 8 to 14fps. Can the rife ai do this to anime https://www.reddit.com/r/nvidia/comment … ation_gpu/

4 Reply by flowreen91 (edited by flowreen91 16-05-2024 02:26:35)

  • Thanks: 74
  • Thanks for the post: 1

Re: How to configure Rife Ai for character motion

Hatsune Miku wrote:

I've seen so many demos of rife ai making 8fps gifs look smooth. I figured it could do that to anime since the characters still move at like 8 to 14fps. Can the rife ai do this to anime https://www.reddit.com/r/nvidia/comment … ation_gpu/

Yep, that's a rife presentation video. Latest rife neural engine models have less interpolation issues. But never zero. It's still one of our best options for conversion on-the-fly while you watch the video.
You can try to follow this small guide to download latest models, and then resize the video down until you can test 120 or 240 fps smoothness.
https://www.svp-team.com/forum/viewtopi … 352#p83352
(if you tell the AI model to generate more frames, then it will improve the accuracy of the interpolation and your eyes won't notice any interpolation issues unless you spam pause every 0.5 seconds lol)
Have a look what it generated and compare:
https://drive.google.com/drive/folders/ … CKnKGieUtb

  • Thanks: 1599
  • Thanks for the post: 1

Re: How to configure Rife Ai for character motion

> I figured it could do that to anime since the characters still move at like 8 to 14fps.

RIFE interpolates between two adjacent frames only. If there's no motion between two frames it will do nothing.

In a simple case when characters animated at, for example, 12 fps while the video is 24 fps, you could "remove every other frame" making 12 fps video, and then interpolate it.