1,976

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:
dlr5668 wrote:
RickyAstle98 wrote:

I forgot that I used 2x2 all the time

How do you do that? I use only v2 models (for better rewind speed) and wanna try. How does it affect model performance?

What do you mean?

My bad I missed line about align/valign

1,977 (edited by flowreen91 26-09-2024 19:18:04)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

pensioner600 wrote:
Xenocyde wrote:

Will test MPC-BE for microstuttering.

If you plan to melt above 160 fps, then I recommend version 0.7.1.2172 of mpcVR. Here (and in the following messages) it’s clear why.  The developer does not fix this error and wants a high-frequency monitor))
https://mpc-be.org/forum/index.php?topi … 18#msg8818

@pensioner600 The mpcVR devs are looking for you:
https://mpc-be.org/forum/index.php?msg=8944

1,978 (edited by pensioner600 27-09-2024 20:11:24)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:

@pensioner600 The mpcVR devs are looking for you:

Yes, I saw it, thanks!

I didn't like 4.26 at all.
I usually compare them on this video.
https://drive.google.com/file/d/1OQAHl3 … sp=sharing

At 57 seconds on Steve Carell's nose.
4.18 is the best nose.
4.15lite is a little worse.
4.26 is the worst nose, it doubles.
The nose is an example where everything is clearly visible. In my other testing moments, 4.26 also showed itself poorly.
Before this, 4.15lite was the best model for me. I'm switching to 4.18 for now. I'll test other models when I have time. But 4.26 is very bad.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

pensioner600 wrote:

4.18 is the best nose.
4.15lite is a little worse.
4.26 is the worst nose, it doubles.

4.26 was the worst for me as well in my testing, it was very stable in some scenarios, but horrible in others.

If you never tried 4.25 by the way, give it a try. I use it instead of 4.18 now for 4K ≤ 1699 frame height. If you have the 4090 you can use it for everything.

1,980 (edited by madchickendog 03-10-2024 00:38:56)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Is anyone having success using rife 2x framerate 48fps or more with an rtx 4080 super?

I have 12700k 32gb ram, 16gb ram on gpu.

I cant find much anecdotal comments on people having success with RIFE with UHD content without a 4090.

I am having stable smooth interpolation only at 1080p 48 fps, anything more than that jitters or plays in slower motion including slower audio.

1,981 (edited by Blackfyre 03-10-2024 02:30:23)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

madchickendog wrote:

Is anyone having success using rife 2x framerate 48fps or more with an rtx 4080 super?

I have 12700k 32gb ram, 16gb ram on gpu.

I cant find much anecdotal comments on people having success with RIFE with UHD content without a 4090.

I am having stable smooth interpolation only at 1080p 48 fps, anything more than that jitters or plays in slower motion including slower audio.

RTX 3090 and I didn't upgrade to the 4080 Super because I saw reports before that people who upgraded struggled.

But surely it depends on which model you are using.

First of all, I recommend testing with RIFE 4.9

Second test with v2 Models, as they perform better. But you need to scroll up and find the files on the last page or page before that to replace, so it fixes screen shake issue that happens with v2

Third, overclocking MEMORY clock speed helps RIFE performance.

This below is basically the reason why the RTX 3090 outperforms the 4080 and 4080 Super with RIFE, someone can correct me if I am wrong:

The RTX 3090 boasts an additional 8GB of VRAM and features a broader 384-bit data bus, surpassing the 256-bit memory of the RTX 4080. Furthermore, its impressive 936.2 GB/s memory bandwidth is a 30.6% advantage over the RTX 4080’s 716.8 GB/s.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Blackfyre wrote:

This below is basically the reason why the RTX 3090 outperforms the 4080 and 4080 Super with RIFE, someone can correct me if I am wrong:

The RTX 3090 boasts an additional 8GB of VRAM and features a broader 384-bit data bus, surpassing the 256-bit memory of the RTX 4080. Furthermore, its impressive 936.2 GB/s memory bandwidth is a 30.6% advantage over the RTX 4080’s 716.8 GB/s.

That definitely applies to v4.16. But for other models, the 4080's overall performance improvement (also massive efficiency improvement but not relevant here) will probably make up the difference.

1,983 (edited by Gippy 03-10-2024 18:13:50)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Watching 1080p anime with RIFE set to 60fps and with MadVR postprocessing to 4K. 4080 Super, AI 4.9.

I'm finding that with RIFE TensorRT, outlines and edges shimmer (the outline width noticeably changes) when panning or scrolling happens. This does not happen with RIFE ncnn/Vulkan or standard SVP interpolation. I tried changing AI models and they all do this. Disabling MadVR doesn't seem to fix it either; it happens with all renderers. It's off-putting enough that I've stuck with standard SVP interpolation for now. Is there a fix for this, or is this a known issue? There's no point in the performance increase of TensorRT if it looks like dogshit.

1,984 (edited by flowreen91 03-10-2024 18:24:57)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Please try to record your screen with an obvious scenario of "outlines and edges shimmer (the outline width noticeably changes) when panning or scrolling happens."
That way SVP developers can check and fix the issue hopefully.
Also mention where you downloaded the source of that video sample so they can download it too from same place and compare.

Blackfyre mentioned a recent "shake" issue:
https://www.svp-team.com/forum/viewtopi … 509#p85509
that gets fixed with this:
https://www.svp-team.com/forum/viewtopi … 522#p85522

Maybe what u found is something new.

1,985 (edited by Gippy 03-10-2024 20:17:08)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:

Please try to record your screen with an obvious scenario of "outlines and edges shimmer (the outline width noticeably changes) when panning or scrolling happens."

http://nnl1.com/misc/TensorRT-Bug.mp4

This is a 1440p60 file so please watch it at 100% zoom. First I play it with standard SVP which looks great. Then I replay it with RIFE TensorRT. Focus on the uniform edges, specifically the shoulder crease marks. This becomes very obvious when blown up to a large 4K TV.

madchickendog wrote:

Is anyone having success using rife 2x framerate 48fps or more with an rtx 4080 super? I am having stable smooth interpolation only at 1080p 48 fps, anything more than that jitters or plays in slower motion including slower audio.

I can get 1080p120 with TensorRT and MPC Video Renderer, using 90% GPU. I can get 1080p60 with TensorRT and MadVR with the NGU Sharp scaler set to High, along with some other postprocessing like Sharpen/Crispen/Thin Edges. This uses 80% GPU, and is what I normally do because my Sony TV can then use its own Bravia XR interpolation processing to go from 60fps to 120fps. However, due to the TensorRT bug I'm experiencing, I've switched back to standard SVP for now. I'm able to increase the NGU Sharp scaler from High to Very High because standard SVP can be all done on the CPU. (To force this, Application settings > GPU acceleration > no acceleration) Note that the NGU Sharp scaler is very GPU intensive, so if you're using that, be careful when adjusting.

1,986

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Gippy wrote:

Watching 1080p anime with RIFE set to 60fps and with MadVR postprocessing to 4K. 4080 Super, AI 4.9.

I'm finding that with RIFE TensorRT, outlines and edges shimmer (the outline width noticeably changes) when panning or scrolling happens. This does not happen with RIFE ncnn/Vulkan or standard SVP interpolation. I tried changing AI models and they all do this. Disabling MadVR doesn't seem to fix it either; it happens with all renderers. It's off-putting enough that I've stuck with standard SVP interpolation for now. Is there a fix for this, or is this a known issue? There's no point in the performance increase of TensorRT if it looks like dogshit.

Can you try different model? 4.9 is quite old and bad with non integer multipliers. Try 4.15 lite v2, 4.18 v2, 4.25 v2

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Gippy wrote:

Watching 1080p anime with RIFE set to 60fps and with MadVR postprocessing to 4K. 4080 Super, AI 4.9.

I'm finding that with RIFE TensorRT, outlines and edges shimmer (the outline width noticeably changes) when panning or scrolling happens. This does not happen with RIFE ncnn/Vulkan or standard SVP interpolation. I tried changing AI models and they all do this. Disabling MadVR doesn't seem to fix it either; it happens with all renderers. It's off-putting enough that I've stuck with standard SVP interpolation for now. Is there a fix for this, or is this a known issue? There's no point in the performance increase of TensorRT if it looks like dogshit.

When doubling FPS of the test scene from here:
https://www.svp-team.com/forum/viewtopi … 509#p85509
We can see how the directly generated video of RIFE has no shake of the white lines on the right side of the screen.
But when transcoding it with SVP, every interpolated frame has different positioning of the white lines than the non-interpolated frames.
It's like you show the video normally on the non-interpolated frames and then reduce the height by a few pixels on the RIFE generated frames which makes the pixels not align with the original movie, adding a shake-like effect on the static white lines that is obvious for big screen users.

SVP devs please take a look:
https://drive.google.com/drive/folders/ … gbYN3w1Eeo
Thanks!

1,988 (edited by Gippy 04-10-2024 19:07:26)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

flowreen91 wrote:

But when transcoding it with SVP, every interpolated frame has different positioning of the white lines than the non-interpolated frames.
It's like you show the video normally on the non-interpolated frames and then reduce the height by a few pixels on the RIFE generated frames which makes the pixels not align with the original movie, adding a shake-like effect on the static white lines that is obvious for big screen users.

You might be on to something here. When using TensorRT and a 1080p model is being configured, the model is set up as 1920x1088, not 1920x1080. This is because 1088 is divisible by 16 but 1080 isn't.

Anyway, I hope this bug gets resolved soon, as RIFE needs to be almost perfect to justify using it over standard SVP. Standard SVP with best settings only requires 4 cores @ 60% CPU on my 12900K, while RIFE is a GPU killer.

EDIT: This bug also occurs with 1280x720 video, and the shimmering happens at that resolution, too. The model is set up as 1280x736.

1,989 (edited by RickyAstle98 04-10-2024 15:46:41)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Any possibility to make black frame insertion like vf-append or deinterlace filter that doubles the FPS? I mean what IF any other black/grey frame for motion debluring?

1,990

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:

Any possibility to make black frame insertion like vf-append or deinterlace filter that doubles the FPS? I mean what IF any other black/grey frame for motion debluring?

You can edit source scripts in SVP folder. Not many have 240 hz OLED for it to be useful

1,991 (edited by RickyAstle98 04-10-2024 18:34:51)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:
RickyAstle98 wrote:

Any possibility to make black frame insertion like vf-append or deinterlace filter that doubles the FPS? I mean what IF any other black/grey frame for motion debluring?

You can edit source scripts in SVP folder. Not many have 240 hz OLED for it to be useful

The OLED? The BFI still benefits for any panel types, my chinese 180Hz IPS sad
How to edit source script to make every other frame black? thanks!

1,992 (edited by dlr5668 05-10-2024 03:37:13)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:
dlr5668 wrote:
RickyAstle98 wrote:

Any possibility to make black frame insertion like vf-append or deinterlace filter that doubles the FPS? I mean what IF any other black/grey frame for motion debluring?

You can edit source scripts in SVP folder. Not many have 240 hz OLED for it to be useful

The OLED? The BFI still benefits for any panel types, my chinese 180Hz IPS sad
How to edit source script to make every other frame black? thanks!

Even SVP dev cant do it in 1 try. Dump SVP 4\script into chatgpt/claude and start debugging until you get it right or bored. Thats how I would start

1,993 (edited by RickyAstle98 05-10-2024 08:34:55)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:
RickyAstle98 wrote:
dlr5668 wrote:

You can edit source scripts in SVP folder. Not many have 240 hz OLED for it to be useful

The OLED? The BFI still benefits for any panel types, my chinese 180Hz IPS sad
How to edit source script to make every other frame black? thanks!

Even SVP dev cant do it in 1 try. Dump SVP 4\script into chatgpt/claude and start debugging until you get it right or bored. Thats how I would start

Actually that easy to implement as I said earlier vf-append/vf-fps or deinterlace filter, without feature primary target, put black PNG over and over, devs can do that too easy, I dont use AI debugger sorry!

1,994 (edited by dlr5668 05-10-2024 11:15:23)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

RickyAstle98 wrote:

Actually that easy to implement as I said earlier vf-append/vf-fps or deinterlace filter, without feature primary target, put black PNG over and over, devs can do that too easy, I dont use AI debugger sorry!

Will it handle fps correctly? For example, start at 24. Triple with rife to 72. Add BF to 144. Then player receives 144 and switches display to 144 Hz mode. GSync and BFI is no no imho. I think its better done inside svp scripts

1,995

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Is it possible to use RIFE in the JRiver media center?

1,996

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

allexmv wrote:

Is it possible to use RIFE in the JRiver media center?

if you can add 'Vapoursynth Filter' then yes

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:
RickyAstle98 wrote:

Actually that easy to implement as I said earlier vf-append/vf-fps or deinterlace filter, without feature primary target, put black PNG over and over, devs can do that too easy, I dont use AI debugger sorry!

Will it handle fps correctly? For example, start at 24. Triple with rife to 72. Add BF to 144. Then player receives 144 and switches display to 144 Hz mode. GSync and BFI is no no imho. I think its better done inside svp scripts

Yes it will handle fps correctly, just like an filter works ontop, but instead of repeating frames, put black PNGs, no matter what display refresh rates with GSync window, since monitor will synced to output, so 72Hz with 2 black frames instead 2 repeated frames for clear motion, GSync will synced to 72 respectively!

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Can someone explain which settings are the best for a 4090 on 7950X3D to run 4K videos? 4.16_lite or 4.18? How many GPU threads, etc?

1,999 (edited by Blackfyre 06-10-2024 23:50:13)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

kellykline wrote:

Can someone explain which settings are the best for a 4090 on 7950X3D to run 4K videos? 4.16_lite or 4.18? How many GPU threads, etc?

Remember the first time you run any new video resolution with any changed RIFE version the popup comes up and cache needs to be built. Every time after that, with the same RIFE version and same resolution you previously ran, it should start immediately.

Just wanted to provide that note, as people aren't aware sometimes they just have to wait for that popup to finish its thing and not close it.

Okay, I have an RTX 3090, so I will speak from my experience with that and scale up for the 4090.

Instead of interpolation To Screen at the top, I run Movie x2, and using a program called Custom Resolution Utility (CRU) I create a custom resolution to create a 48Hz refresh rate 4K to switch to in the nVidia control panel when I want to watch a TV show or movie.

With an RTX 4090, if you can change your refresh rate to 4K 60Hz, 10bpc, RGB, full and perhaps test using To Screen, which will interpolate to 60 FPS at 60Hz, you might be able to push that, hopefully. I can't with the 3090, but perhaps that 4090 is able to do 60 FPS @ 4K, if it can't test Movie x2, and if that works properly, then crease a custom resolution with the method above using CRU.

Matching the FPS and display Refresh Rate gives a smoother experience. I had issues with VRR working properly before (flickering on OLED), so that's why I switch everything manually myself.

For the best RIFE version to use, the developer says 4.18 is the best one, but IMO the best version I have used, with the least visual anomalies, is version 4.25, which was a beta version of 4.26 (which for me is the worst).

Let me know how it goes, as I am interested in knowing the 4090 performance, if the 5090 is too expensive, I might switch to a 4090.

2,000

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

@Blackfyre
The topic about the rtx 4090 graphics card  performance has been commented many times, incuding by me.
Here it is https://www.svp-team.com/forum/viewtopi … 248#p85248


Here is some further general information:
I'm pretty sure that the developers of the RIFE Large Language Models are also using a rtx 4090 graphics card (either for training or inference) and are strictly tuning their parameters, model size etc. to match/fit into the rtx 4090's maximum machine learning & inference performance, when running their models at maximum ~3840 x 1600 resolution (so basically all 21:9 movies).
Been monitoring it since 2020 the rtx 3090 graphics card came out and how it behaved with RIFE's models.
The developers always made strictly sure that nvidia's top dog GPU-die (xx102 used in xx90 cards) is at least able to run 48 fps around the ~ 3840 x 1600 resolution for their current models (as I linked above).
They very likely won't create a model for which the current top-dog's GPU-die won't be able to run with those settings; it would defeat their purpose and obviously be the wrong path, not catering to the markets needs (us, consumers. "What's the best point of creating a too-demanding model, if no one would be able to run it?").

Equally (as linked and commented), the rtx 4090 isn't able to run above that resolution & framerate since the RIFE 4.15 model or so (I remember it started with that version I couldn't run 3840 x 1600 at 60 fps anymore).