New RIFE filter - 3x faster AI interpolation possible in SVP!!! (Page 82 of 82)

Chainik wrote:

BTW: if you just replace vsmlrt.py with the latest git, then it will use V1 models instead of V2

Yes, cause in december 2023 the dev updated the signature of the RIFE method:
https://gyazo.com/bde7edb2b4deb80294dbbaf71b757cc2
but he didn't add it as last element of the method so please fix it by updating helpers.py to send video_player True or False as 10th parameter:

return RIFE(clip,multi,1.0,None,None,None,model_num,backend,ensemble,False,implementation)
or
return RIFE(clip,multi,1.0,None,None,None,model_num,backend,ensemble,True,implementation)
(not sure which one is best for SVP)

Chainik wrote:

I'd say this's because of color space converted back and forth, noticeable in a very high contrast areas only.
Probably
...and your "shaking" is not like Blackfyre's V2 shaking, which is quite obvious not only on those lines but in a whole frame

Yes, i think you're right. I tried to simplify the base.py and generate.js and ended up with this:
https://gyazo.com/5f8efd7ead2c79d6a3afeaa852161184
but micro shaking still persists. Which confirms that it's caused by the color space conversion required for Vapoursynth.
Easiest way to fix it would be to allow Vaporsynth to also apply the same conversion process on the source frame too.
This way all outputed frames should line up and 100% fix the micro-shaking.
Is this possible? (even if it will increase the computational processing needed)

Blackfyre's V2 whole-frame obvious shaking takes priority, though.
Thanks again for putting the time and effort to look through the magnifying glass.

@jdg4dfv7
Ok, a lot to read. Let's start by making the following clarification, when I mentioned not being interested in 0.25 speed test, I meant not doing it. But in no way was my intention to minimize your efforts in testing it in a less flawed way. I doubt that this matters to you, since you are not here for the opinions of others. I really appreciate and see the value of this type of tests, but I am convinced that the real benefit of your tests is  directly with the Rife developers and I don't believe they see it as child's play, your findings may lead them to see something they can improve and extend the benefits to all of us.I encourage you, if you don't already do it, to send it to them in some way.
After reading everything else the only thing I can say is, thank you for taking the time to test and respond but from here on out I am not going to quote directly or respond to any of your post. Because I can see that it's just going to lead to endless, pointless arguments that benefit no one. And in a few days the thread will probably have 200 worthless pages.

For everyone else, I really interest on the "flawed"visual testing on normal speed playback of scene like a mentioned (Doc Op vs Spiderman under the bridge) or any other scene with obvious artifacts like this one,the kind that don't need to have superhuman vision to be able to spotted.

RickyAstle98 wrote:

4) The 4.26 has significant artifacts for me even at normal playback speed, which not happens with older models, sometimes even parts of big objects interpolating separately than full object, which still not happens for older models testing, no matter what playback speed was set, I dont say 4.26 will work the same for others, atleast thats how 4.26 works for me, period!

Looking at you, and comments like this(whichever your preferred model) plus some scene example.

If you dont have the file in cuestion, can use this on youtube in the resolution you prefer or downscaling via svp.
https://www.youtube.com/watch?v=CC5c8LyPyuk&t=13s

RickyAstle98 wrote:

The problem is with mpv and SVP both, because this issue happens too often realtime playback, doesn't necessary for example videos...

Do you try it with this scene?
In my case for the example scene, happen exactly same position same way every time except on v4.25

I checked it many more times 4.26. It's surprising that many people don't see her mistake. No, I stay at 4.18, that's the best for me.

new version of SVP?

updated vsmlrt.py to fix "Blackfyre's V2 shaking"

video doesn't look like its been smoothed

Nope no dice. It looks like its dropping frames doesn't report that it is. I've just tried an AI Enhanced version of Wolverine Deadpool and I can notice the smooth motion immediately. At the same settings reported at 60FPS (Rife) it doesn't look smooth. If I turn on the OG frame interpolation, again I notice it (and the artifacts straight away).

I'm coming close to doing a clean windows install at this point.