Guys, I'm confused.

On a 48Hz display, SVP can simply double a 24fps movie to 48fps.

So the frame sequence looks like

Real Fake Real Fake Real Fake Real Fake Real Fake Real Fake


However, how does SVP sync 24fps to 60Hz displays?

60Hz / 24fps = 2.5x fps required to sync. How does it generate half in-between frames? Can someone explain to me the mechanism?

Does it insert a generated frame every 2 frames, so it looks like this?

Real Fake1 Real Fake1 Fake2 Real Fake1 Real Fake1 Fake2 Real Fake1 Real Fake1 Fake2 (This would cause microstutter)

Or something else?

I don't understand you folks downscaling 4K content.

With RIFE ~4.4/4.6, you can easily get 2X - this will up 24fps to 48fps, but YOU MUST CREATE AND USE A CUSTOM 48Hz @4K resolution! It is buttery smooth.

Higher than 2X gives diminishing returns, and really isn't worth the quality loss from downscaling the image to get there.

RickyAstle98 wrote:
RAGEdemon wrote:
RickyAstle98 wrote:

Something is wrong, because 4.16 lite working at 4K with my RTX 4070 without dropped frames
But 4.15v2 (nonlite) is very strong, I down 2160p to 1800p - works!

Bro, you can easily get 4K RIFE: use 4.4 to double your fps and sync to 48Hz refresh (for 24fps source). Honestly, it looks butter smooth. I would be hard-pressed to notice this vs 60/120. The magic is ensuring the output FPS matches your refresh.

I know about my 4070 capabilities, but in 4.4 too much artefacts (not critical but noticeable), secondly I dont need sync anything, GSync matches movies automatically! No magic at all!
My standard solutions for movies >
1) 4.4v2 1280x720 24>144
2) 4.9v2 1280x720 24>144
3) 4.15v2l 1280x720 24>144

Each iteration after 4.4 causes a massive performance hit @~16% for minimal artefact improvement. Above 4.9 is trained mostly on Anime.

What you say doesn't make sense to me. You say you don't use 4.4 because "too much artefacts (not critical but noticeable)", but then you are happy to force downscale all 4K and 1080p content to 1280x720p?! And you don't notice the huge degradation in quality?

I am guessing you don't have a 4K display, or else you wouldn't be saying something so seemingly bizarre smile

To each their own, I guess...

RickyAstle98 wrote:
Blackfyre wrote:
Drakko01 wrote:

I honestly dont remenber what I changed in the old vs-mlrt. Because I run into this problem before

All I done was disable hardware-accelerated GPU scheduling. Restarted the PC, and it built after.

Didn't help though, none of 4.15 versions or 4.16 work at 4K without dropped frames on my RTX 3090

Something is wrong, because 4.16 lite working at 4K with my RTX 4070 without dropped frames
But 4.15v2 (nonlite) is very strong, I down 2160p to 1800p - works!

Bro, you can easily get 4K RIFE: use 4.4 to double your fps and sync to 48Hz refresh (for 24fps source). Honestly, it looks butter smooth. I would be hard-pressed to notice this vs 60/120. The magic is ensuring the output FPS matches your refresh.

537.58 eliminated the pan stutters for me.

My permanent setup is now 4K (3840x2160) with RIFE 4.4 with this driver. RIFE/SVP is set to double the frame rate. (with RTX 4090 @ 65% GPU usage)

For those who don't know, this makes all content (24fps) into 48fps. You MUST make a custom resolution to make your refresh rate 48Hz, or it will be stuttery because 48fps does not go into the default 60Hz/120Hz that the vast majority of monitors/TVs are.

4K 48fps @ 48Hz video is perfectly smooth. This is easy for SVP because it is just doubling the frame rate.

Other modes such as sync 24fps video to screen refresh, or fps x 2.5, or whole multiples, is really taxing on the GPU. An overclocked 4090 can't do it, even on the highest performing RIFE (4.4/4.6).

Gentlemen,

Consistent reports are emerging regarding recent nvidia drivers causing stuttering in apps and games. It is related to the DPC latency.

Current advice is to roll back to 537.58 drivers (dated October 2023).

More info in the COMMENTS in this thread:
https://www.reddit.com/r/nvidia/comment … iscussion/


I believe I have seen these stutters in SVP too. Rolling back to the recommended driver fixed the issue. Best staying on the older driver till a confirmed fix has been integrated...

cws wrote:

Does it still happen when using the latest version from https://github.com/AmusementClub/vs-mlrt/releases? SVP might be using the last non-test release (v13) instead of the latest testing release (v14).

I don't know what this means. Would you kindly explain?

I am using SVP with the models downloaded into the RIFE and RIFEV2 folders, with MPV video player.

How do I install what you mention, and what are the benefits? Will I get better performance? I am on a quest to get 4K60 @ 10-bit. The closest I have come is 4K48 @ 10-bit  - Thank you smile

SVP is not offering updates, so presumably I am on the latest version. I can also confirm jiggling, most noticeable to the bottom right. I think 4.6V2 is the worst.

Hi guys,

I am trying to get 4k content to run at 60fps. Sometimes I manage it, but most times, the best I can do is double the movie FPS. Ideally, 4k120fps would be awesome.

How can I try to do that? I have tried 4.4,4.6,4.9,4.12. 3/4 threads.

I am on a 4090.

I'd appreciate help, thank you smile

flowreen91 wrote:
RAGEdemon wrote:

How do I update to the latest version of RIFE for live conversion?

A simple list of instructions would be wonderful, thank you smile

The brilliant SVP developers made it extremely easy to install.
First you update SVP to latest version by right clicking it from task bar --> Utilities --> Additional programs and features... --> Update components --> Next >
https://gyazo.com/1702ec66e0a1210c4f4d25fdfbe34aeb
Then you download latest RIFE from the bottom of the page here:
https://github.com/AmusementClub/vs-mlr … nal-models
Currently the latest one is this 2 days ago archive:
https://gyazo.com/637173b715eac98073928e66946ef256
Then you copy the contents of the folder from the archive into this SVP folder ("C:\Program Files (x86)\SVP 4\rife\models\"):
https://gyazo.com/6f2c1eff9a6a459fbd411faa11efbacb
How the files should look if copied correctly:
https://gyazo.com/2f640fe54815c061392cd0760dc37624
Please restart SVP. If done correctly, you should be able to select the new version from the AI model list.
Enjoy!

Amazing, Thank you!

+ An addition for some of us oldies - the RIFE TensorRT Engine does not show up until you go into the components and install the new RIFE/TensorRT Option. Then it will work!

Are there any options you would suggest? I see people have set GPU threads to 4 (default 2). And you are using the lite version, vs the standard version...

thanks again - very helpful. I think your post will be reverenced many times going into the future... smile

Guys, I am so confused. Everything seems to be so complex. I have been reading this thread for hours now...

I am running SVP via RIFE and MPV. SVP CPL shows it is using RIFE v 4.4.

How do I update to the latest version of RIFE for live conversion?

A simple list of instructions would be wonderful, thank you smile

What if I were to tell you that there is a way to further triple the speed of RIFE without any noticeable loss in image quality?

In fact, the IQ will likely improve, and that it's Open Source / Free to implement?

Well, here is the solution:

Some of you might know that AMD have been working on FSR for games, but it also works just as well on videos...

As you know, it basically doubles/triples/quadruples the gaming performance for free (virtually no impact on the system), much like DLSS - but it's a shader which works on /all/ cards. My ancient 1280x800 projector + FSR looks almost identical to DSR 4x (2560x1600). In my particular experiments, I am getting 400% performance.

https://cdn.videocardz.com/1/2021/06/AMD-FidelityFX-SuperResolution-FSR-19.jpg

https://cdn.videocardz.com/1/2021/06/AMD-FidelityFX-SuperResolution-FSR-20.jpg

https://cdn.videocardz.com/1/2021/06/AMD-FidelityFX-SuperResolution-FSR-21.jpg

https://cdn.videocardz.com/1/2021/06/AMD-FidelityFX-SuperResolution-FSR-22.jpg



My humble suggestion: Allow the user to select FSR level in SVP options, so that, e.g. RIFE will be able to use FSR to render 4K videos at the cost of 720p videos, LIVE.

FSR's sharpening pass does some heavy lifting, so I would ask the kind developer to please expose this setting too. For me, FSR set to BALANCED with sharpening set to 1.0 (usually variable between 0.0 and 1.0) looks much better than NATIVE 4K, while giving me >2x the performance.

This has the potential to radically increase SVP's performance. Already it is being implemented into most upcoming games, while already released games are being patched with the feature retroactively such as CyberPunk 2077 and MS Flight Simulator 2020; - as well as VR, where it brings so much to the table that people have started using injectors to enable it in older games which don't come with it natively.

Github FSR 1.0 : https://github.com/GPUOpen-Effects/FidelityFX-FSR

FSR 2.0 available soon...

Kind regards.

Wow, thank you (especially to the devs!) I had no idea that option existed! SVP is a gift that keeps giving! big_smile

Is there a way to downscale 1080p/4K content down to 720p BEFORE RIFE interpolates it live?

The objective is to have my high resolution videos downscaled to 720p so that I can use x3/x4/x5 RIFE.

With MPC/ffdshow, this was easily done by just rescaling the video in a step above AVISynth, in the FFDshow settings... I can't figure out a way to do it on mpv...


Thank you.

15

(0 replies, posted in Using SVP)

I have an 8-bit display and use SVP4+FFDShow+MPC-HC on a Windows 10 machine.

8-bit videos work great. However, when I play 10-bit videos (most/all 4k videos seem to be 10-bit nowadays), there is heavy banding on my display:

https://ibb.co/mJPMrFL

As one can see, the results are quite atrocious.

I understand that some people have tried playing around with LAV filters or MPV player advanced config to try and fix this. I have neither of those and am otherwise happy with my setup.

Is there a way to fix this problem?

Thanks.

Thank you for the education - always a pleasure to get direct responses from Devs!

I am eagerly looking forward to SVP on android when it does release!

This is the source which confused me (I am not a coder); it looks like true motion vectors would only work on the PC version:

https://gist.github.com/phiresky/4bfcfbbd05b3c2ed8645

We all know SVP does not support Android / iPhone (yet). However, new discovered SOFTWARE and newly developed HARDWARE now allow you to do motion smoothing on mobile devices...



1.

OnePlus and OPPO phones now have 120Hz AMOLED screens and officially support motion smoothing in a veriaty of popular apps such as youtube/netflicks/VLC etc.

https://www.oneplus.com/uk/os/memc

https://www.oppo.com/uk/smartphone-find-x2/

=============

2.

Furthermore, I have discovered a gem of a player for (almost) ALL modern Android and iPhone devices which natively supports frame rate interpolation using shared SVP libraries.

The player is called MPV Player and is available on the app store. Simply go into the options while a video is not playing, and enable Interpolation under the Video settings to have it interpolate the FPS and sync to your display refresh. It will depend on the power of your mobile device of course, but my testing shows that it consumes not-too-significant CPU/memory/battery to be noticeable - the biggest battery drain will always be your screen no matter what video player you use; with or without motion interpolation.

The player is also very powerful in that you can edit the config file under the advanced settings to add things like a sharpening filter (I have added SHARPENING=5.0 - I am now blown away by detail; I often wonder why players don't have this feature enabled by default because it adds so much.

for devs or tech folk, the guthub manual etc are here:

https://mpv.io/manual/

So, demos show that NVidia's Optical flow is absolutely amazing... unfortunately not so much with SVP4's implementation of it:

In theory, the image sharpness and the reduced load is so good that it's incomparable to standard motion vectoring.

NVidia developer Demos show NVidia Optical Flow to be extremely fluid-smooth, even at 60FPS (as opposed to 120FPS)

Unfortunately, turning this option on in SVP4, although greatly reducing system load and perhaps making the image more crisp, produces a very stuttery motion. Indeed it is little better than non-SVP 24FPS, but it's NOT nearly as smooth as 60fps Standard SVP motion vectors and certainly not 120fps (my display is 120Hz\120FPS).

My gut feeling is that the NVidia Optical Flow algorithm in SVP4 is set to very low.

This is an amazing technology. Please can we fix this issue, or perhaps give users the option to increase the fluidity with the NVidia Optical Flow option?

Thank you kindly! smile