1,801

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

https://www.svp-team.com/forum/viewtopi … 921#p84921
@Chainik
@flowreen91
Thanks again you both for explanations and providing solutions. I've read both comments, tried mentioned solutions, also with new uploaded file.
That one fix with replacing a line and switching a file still didn't work out either.

1) For now I keep using the TensorRT 9.2 library, "v14.test4: latest TensorRT and ONNX Runtime libraries" from march 27, for best performance/efficacy.
2) At least for now, I didn't notice much difference between NVOF and SVP motion vectors. Looks all fine, though I keep NVOF for best performance.

If it works, it works smile

1,802 (edited by jdg4dfv7 03-08-2024 04:07:08)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

@Xenocyde
@Blackfyre

I've (again) tested RIFE 17.v2 , v17.v2 Lite, 18.v2, 19.v2 and 20.v2, with my usual blend of test scenes, in slow motion (x0.25),
looking for usual things as distortions, warping of patterns and objects, artifacts, especially when camera panning etc.
My observations match yours.

1) For me18.v2 is by far the best model regarding all things mentioned.
2) 17.v2 second best model, but with noticeably increase in distortion and warping of patterns and objects, especially when panning.
3) Followed by third best 19.v2 with same issues.
4) Fourth best version 17.v2 Lite with the same artifacts.
5) 20.v2 the worst of them. Not sure what happened here during training. :-(

Especially watching in slowmotion x0.25, artifacts, distortions etc. can be observed with all models, but it's suprising how good 18v2 and 17v2 Lite are looking.
For 1080p@60 fps I keep using 17v2 Lite, and for everything up to
3840x1600 - 4K-UHD resolution, @48 fps, it's v18.v2.



@Asking a question out loud
Anyone having an explanation why even a nvidia rtx 4090 can best do 48 fps up to 3840x1600 - 4K-UHD resolution?
Increasingly, above 3840x1600 resolution @60 fps, playback keeps stuttering no matter what. Already removed other bottlenecks.

Observing hwinfo64 metrics for
- GPU-utilization
- power draw etc.
- task manager
there is a strange discrepancy between all those.

Up to 3840x1600 resolution @48 fps,
- GPU-utilization keeps around 40 - 60 %
- power draw hovers around 170 - 240 watts
- Task Manager: Tensor Cores, 3D, Video Encode & Decode and Copy also far from being fully utilized.

Then, getting close to 3840x1600 resolution @60 fps and above, a sudden disproportionate jumps happens and stuttering keeps occuring.
The ~ 25 % increase in resolution does not warrant the overall increase ... is the GPU bottlenecked by the Tensor Cores? Not enough of them?

1,803 (edited by Insindro 03-08-2024 04:12:54)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Drakko01 wrote:
dlr5668 wrote:
Insindro wrote:

What are your top 3-5 rife models and miscellaneous settings for scene changes? Just want to get a good idea of what everyone is currently using, thanks!

I like 4.15. If you need 30% faster its 4.15 light. 4.20 is nice for anime. Try these models. I only use v2 for faster seek

These days I prefer 4.18 Nvof MV/blend Adjacent Frame x3, 4k files  downscale 1920*1080 upscale 1440p(Rtx 4070ti)


I agree with both of you. 4.15 and 4.18 rife models are definitely the best models for movies so far. Anime I’m not sure about, I didn’t like 4.20’s interpolation accuracy at all. Seems it’s only beneficial if you can run at x16 interpolation. If there are any anime watchers here what rife models are you using? Let me know, thanks!

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

jdg4dfv7 wrote:

1) For me18.v2 is by far the best model regarding all things mentioned.

I agree, somehow v19 and v20 managed to break something and now they stretch the images instead of smoothly moving them vertically:
https://github.com/hzwer/Practical-RIFE … 2253162650

1,805

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Finally figured out what to do with HFR sources. My Doctor Who Season 10 is 50 fps by default and if I enable RIFE, my 60 Hz TV is not displaying 100 Hz or 125 Hz properly, so it's barely better than with RIFE turned off especially noticeable with panning shots. There is a simple fix for this, but it somehow did not occur to me until now: "remove every other frame" must be turned on. And of course fixed 60 FPS. That's it, that simple.

1,806

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Which rife model is the fastest? I want to try 4k on 3080ti

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

lurker wrote:

Which rife model is the fastest? I want to try 4k on 3080ti

Remember the first time you run any resolution you have to allow RIFE to build its cache, this will take a while but it only happens ONE time for each resolution.

The only three you should test are:

4.6 - old stable one we used for a while

4.9 - another very stable one that performed well. Might be the best one you can use.

4.16_lite (v2) - pushes my RTX 3090 to the limit while allows me to watch 4K.

Create a custom refresh rate of 48Hz using CRU (you have learn how), if you have an LG TV I can help you.

Before I watch, I switch to 48Hz, enable HDR, and then enjoy.

Also some things I found out. If you overclock, memory overclocking helps RIFE a lot. I was able to achieve much better temperatures by overclocking my memory on the RTX 3090, and downclocking the core. Allows me to watch movies and TV shows while the PC remains relatively silent and inaudible compared to the speaker volume.

1,808 (edited by lurker 04-08-2024 23:33:50)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Now i have problem with rife v2
https://www.svp-team.com/forum/viewtopi … 260#p85260
4.6 and 4.9 too hard to work in 4k

Create a custom refresh rate of 48Hz using CRU (you have learn how), if you have an LG TV I can help you.

I have lg49nano866na but all my attempts to create a 48 fps mode turned out to be failures
ok. I will try to overclock
UPD 3080ti@2000\10670mhz rife 4.6 work with 3840x1600@24fps but have HUGE lags with 3840x2160@25fps

1,809 (edited by dlr5668 04-08-2024 23:10:26)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

lurker wrote:

Which rife model is the fastest? I want to try 4k on 3080ti

you shouldnt. Get good model like 415 lite, 417 lite, 418 and downscale 4k to manageable resolution like 1440p then use nvidia VSR (quality 1 or 2) to get 4k

if you have spare performance can increase 1440p a bit more. SVP allows it

https://pacoup.com/2011/06/12/list-of-t … solutions/

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Another thing I forgot to mention V2 versions perform better, if they do not work for you, there is a guide here in this thread about how to make V2's work.

lurker wrote:

but have HUGE lags with 3840x2160@25fps

25FPS to 50FPS (2X) is more demanding, a lot more than you would think compared to 24FPS for some reason.

For example, I always have to run 25FPS content with older RIFE models, such as 4.9, than the one I am currently using 4.16_lite (v2).

You can create a copy of your RIFE profile, rename it to 25 FPS for example, and set an "Apply this profile IF..." and choose "Video frame rate", then change to "greater than" and choose 25 FPS and for that you choose the model that works for it.

dlr5668 wrote:

downscale 4k to manageable resolution like 1440p then use nvidia VSR (quality 1 or 2) to get 4k

This IMO is horrible. But if someone prefers smoothness over quality, then 100% the correct method.

1,811

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Another thing I forgot to mention V2 versions perform better, if they do not work for you, there is a guide here in this thread about how to make V2's work.

I set it up according to this instruction. It didn't work. It started working later, though, I don't know what exactly I changed.

For example, I always have to run 25FPS content with older RIFE models, such as 4.9, than the one I am currently using 4.16_lite (v2).

I haven't found a model that my 3080ti can handle in 4k@25fps

This IMO is horrible.

I prefer to use TV to smooth things out. It works better than any SVP method except neural network.

1,812 (edited by flowreen91 05-08-2024 07:21:15)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:
jdg4dfv7 wrote:

1) For me18.v2 is by far the best model regarding all things mentioned.

I agree, somehow v19 and v20 managed to break something and now they stretch the images instead of smoothly moving them vertically:
https://github.com/hzwer/Practical-RIFE … 2253162650

They fixed it in v21:
https://github.com/AmusementClub/vs-mlr … e_v4.21.7z

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:
flowreen91 wrote:
jdg4dfv7 wrote:

1) For me18.v2 is by far the best model regarding all things mentioned.

I agree, somehow v19 and v20 managed to break something and now they stretch the images instead of smoothly moving them vertically:
https://github.com/hzwer/Practical-RIFE … 2253162650

They fixed it in v21:
https://github.com/AmusementClub/vs-mlr … e_v4.21.7z

Nope. The dev says it's the same as v4.20.

1,814

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
flowreen91 wrote:
flowreen91 wrote:

I agree, somehow v19 and v20 managed to break something and now they stretch the images instead of smoothly moving them vertically:
https://github.com/hzwer/Practical-RIFE … 2253162650

They fixed it in v21:
https://github.com/AmusementClub/vs-mlr … e_v4.21.7z

Nope. The dev says it's the same as v4.20.

Can confirm the edge artifacts are still there in 4.21.

1,815 (edited by lurker 05-08-2024 20:55:58)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Good afternoon. I installed rife 4.18 v2.
Through recoding, I doubled the frame rate in two films 3840x1080@24fps, everything is fine.
Launched for 3840x2160@25fps. The image shakes in some scenes. For example, on even frames the image is where it is needed, but on odd frames it is shifted by 1 pixel. How to fix it?

1,816 (edited by flowreen91 05-08-2024 22:18:43)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

lurker wrote:

Launched for 3840x2160@25fps. The image shakes in some scenes.

The tree wiggle issue from here that was only visible on high resolutions on v2 models? (that gets fixed if u upgrade TensorRT)
https://www.svp-team.com/forum/viewtopi … 617#p84617
Or another issue? Please show an example.

According to https://github.com/hzwer/Practical-RIFE … 2268877015
there is a scenario where the image moves incorrectly. Try maybe model 4.7 v2 instead.

1,817

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:
lurker wrote:

Launched for 3840x2160@25fps. The image shakes in some scenes.

The tree wiggle issue from here that was only visible on high resolutions on v2 models?
https://www.svp-team.com/forum/viewtopi … 617#p84617
Or another issue? Please show an example.

https://disk.yandex.ru/i/E3fb4sET5OfYeQ
It is best seen if viewed frame by frame towards the end of the segment.

1,818

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

https://www.svp-team.com/forum/viewtopi … 735#p83735
v14test3 fix problem for me

1,819

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

v15.2 gives me a tiny FPS boost
v14test3 ~150fps vs ~ v15.2 ~158fps, also fixed dynamic shape (Performance boost: off) bug

15.2 changelog:

    Upgraded to TensorRT 10.3.0.

    Fixed performance regression of RIFE and SAFA models starting with vs-mlrt v14.test4. This version may still be slightly slower than vs-mlrt v14.test3 under some conditions, however.

1,820 (edited by dawkinscm 07-08-2024 21:56:10)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:

v15.2 gives me a tiny FPS boost
v14test3 ~150fps vs ~ v15.2 ~158fps, also fixed dynamic shape (Performance boost: off) bug

15.2 changelog:

    Upgraded to TensorRT 10.3.0.

    Fixed performance regression of RIFE and SAFA models starting with vs-mlrt v14.test4. This version may still be slightly slower than vs-mlrt v14.test3 under some conditions, however.

Thanks. I have been waiting for this. On brief testing I don't think I see anything obviously better than 9.2. Maybe I would see more advantages if I wasn't downscaling.

1,821

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:
aloola wrote:

v15.2 gives me a tiny FPS boost
v14test3 ~150fps vs ~ v15.2 ~158fps, also fixed dynamic shape (Performance boost: off) bug

15.2 changelog:

    Upgraded to TensorRT 10.3.0.

    Fixed performance regression of RIFE and SAFA models starting with vs-mlrt v14.test4. This version may still be slightly slower than vs-mlrt v14.test3 under some conditions, however.

Thanks. I have been waiting for this. On brief testing I don't think I see anything obviously better than 9.2. .

I check for this release every day, you always beat me bringing the news first!
Downloading right now and happy beginning to test, by the way if you willing to test I install a Nigthly build of MPC HC that has a beta version of MPC Video Renderer 0.8.6.2274 (git-2024.08.04-d252d91) x64 i dont what if any change but I like more than the one install on svp list.

1,822 (edited by flowreen91 08-08-2024 09:22:52)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Xenocyde wrote:

Can confirm the edge artifacts are still there in 4.21.

The devs fixed the smoothness issue:
https://github.com/hzwer/Practical-RIFE … 2275333756

aloola wrote:

v15.2 gives me a tiny FPS boost
v14test3 ~150fps vs ~ v15.2 ~158fps, also fixed dynamic shape (Performance boost: off) bug

15.2 changelog:

    Upgraded to TensorRT 10.3.0.

    Fixed performance regression of RIFE and SAFA models starting with vs-mlrt v14.test4. This version may still be slightly slower than vs-mlrt v14.test3 under some conditions, however.

Is this finally the time SVP upgrades the out of the box TensorRT version to 10.3.0 and v2 models only for faster performance? xD

1,823 (edited by dawkinscm 08-08-2024 09:24:53)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:
Xenocyde wrote:

Can confirm the edge artifacts are still there in 4.21.

The devs fixed the smoothness issue:
https://github.com/hzwer/Practical-RIFE … 2275333756

Yes but it's still not as good as v4.18.

1,824 (edited by Xenocyde 08-08-2024 09:32:52)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:
Xenocyde wrote:

Can confirm the edge artifacts are still there in 4.21.

The devs fixed the smoothness issue:
https://github.com/hzwer/Practical-RIFE … 2275333756

I haven't noticed any smoothness problems since I don't watch anime. I only tested with my usual football scenes
and 4.21 still has the same edge artifacts as 4.20 in those scenes.

BTW, 4.22 is out. Maybe they fixed it with this one. Testing now.

1,825 (edited by dawkinscm 08-08-2024 09:50:18)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Xenocyde wrote:
flowreen91 wrote:
Xenocyde wrote:

Can confirm the edge artifacts are still there in 4.21.

The devs fixed the smoothness issue:
https://github.com/hzwer/Practical-RIFE … 2275333756

I haven't noticed any smoothness problems since I don't watch anime. I only tested with my usual football scenes
and 4.21 still has the same edge artifacts as 4.20 in those scenes.

BTW, 4.22 is out. Maybe they fixed it with this one. Testing now.

4.22 is the fix he's talking about. It's a little better than 4.21 but overall it has the same artefacts.