Fortune424 wrote:
cemaydnlar wrote:

Does decrease to hd setting have an effect on smoothness or is it just lowering the video quality ? I fell like original video feels smoother than the one with decrease to hd setting.

That button reduces the video to 720P. I can't imagine any situation where it would make sense to use it. It may be that the resolution of the video plays a role in how well the algorithms work, but as far as I know it just uses some kind of cheap scaler to resize the video to 1280x720 before SVP interpolates it.

Whatever scaler it uses it's unlikely to be better than the kind of scalers you can choose with MPV. I would rather choose my own scaler so that I know the quality I am getting.

Fortune424 wrote:
Fortune424 wrote:

The annoying thing about the performance boost for me has been movies that use multiple aspect ratios / resolutions. For example I'm watching Resident Evil (2002) BluRay right now and there's a 16:9 camera, an almost 16:9 camera, a 21:9 camera, 4:3 CGI for the computer vision/security camera stuff, etc. It has stopped to generate the training info a few times. For anime/web content it's not so bad - you've basically just got 21:9 and 16:9 versions of 480P through 4K and then the occasional portrait/4:3 video.

As an aside, I just realized that this is because of SVP's black bar detection. If you disable black bar detection, the number of possible resolutions you need to pre-cache the RIFE info for will decrease... but apparently the reason that exists in the first place is because SVP thinks the bars are part of the video to interpolate if they're NOT removed, so it sounds like you'd be giving up some quality there if you choose to leave it off.

The black bar detection was annoying even before Rife and caused me nothing but trouble. As for interpolating black bars, that makes no sense to me and if there was some kind of weird picture quality issue then they should mention it. But as I said, that would be weird.

Fortune424 wrote:
dawkinscm wrote:
Fortune424 wrote:

I think I can confirm. It really is painfully obvious when you do a side by side comparison. I bet V2 looks worse than the 1080P BluRay would. I guess the free performance boost was too good to be true, for now.

Here's from the opening of the 4K BluRay of Avatar 2:

MPV with stock SVP settings, RIFE 4.6 w/ TensorRT on a 3090.

I don't think it does look worse than a 1080 BluRay. I use VR to watch 3D and as far as I can tell, I don't get the same issues. Maybe there's a resolution issue, but I checked and all the detail is there when compared to the original Blu-ray when using Rife v2 with no quality difference to Rife v1. I also checked a number of difficult scenes from other movies and the same applies there too. So maybe it's a 4K resolution issue but I'm not interested in 4K playback using SVP so I haven't tried that. Stock MPV settings uses gpu and I do notice a marked improvement in quality when using gpu-next with proper configuration so you may wish to try that as well.

You can see in our screenshots that SOMETHING is wrong. It looks a lot more jagged and low res with V2 enabled. It is entirely possible it's only at 4K though. I didn't notice a problem at 1080P, though there is less detail there to begin with so who knows. At this point I'm just going to stick with V1 personally, until the cause is revealed or it is fixed.

Yeah it's clear that there is an issue with aliasing which is one of those things that once you see it you can't unsee it. My MPV config is almost identical to my MadVR config and I've found that the Jinc algorithm works best for both in terms of anti-aliasing.

Fortune424 wrote:

I think I can confirm. It really is painfully obvious when you do a side by side comparison. I bet V2 looks worse than the 1080P BluRay would. I guess the free performance boost was too good to be true, for now.

Here's from the opening of the 4K BluRay of Avatar 2:

MPV with stock SVP settings, RIFE 4.6 w/ TensorRT on a 3090.

I don't think it does look worse than a 1080 BluRay. I use VR to watch 3D and as far as I can tell, I don't get the same issues. Maybe there's a resolution issue, but I checked and all the detail is there when compared to the original Blu-ray when using Rife v2 with no quality difference to Rife v1. I also checked a number of difficult scenes from other movies and the same applies there too. So maybe it's a 4K resolution issue but I'm not interested in 4K playback using SVP so I haven't tried that. Stock MPV settings uses gpu and I do notice a marked improvement in quality when using gpu-next with proper configuration so you may wish to try that as well.

Chainik wrote:

> You never know, I might get a response this time

how do you think, what devs might think about replying the same question for the 100th time? hmm

if you're using your own vapoursynth installation you must be knowing what you're doing

First of all thank you @Chainik I searched and couldn't find any responses to my question about Rife v2 being automatically selected when using Tensor which is why I wasn't happy when I got no response. But in the end it was to my benefit because it made me go through the code. I am pretty sure I had VapourSynth working before so I'm not sure why I installed an external version which ended up breaking it so again I appreciate your feedback. But it did lead to me discovering MPV so the two issues turned into two positives. Apologies and thanks again smile

Xenocyde wrote:
dawkinscm wrote:

I moved away from MPC (with MadVR) because it was usable with Rife. With MPV I get better performance, almost perfect smoothness, less artefacts and much better interpolated picture quality than with MPC/MadVR so I can never go back. With a 3070 laptop GPU you are always going to have issues but maybe with MPC it will work better for you.

I installed MPC-HC and configured it to run through VapourSynth. Have you tested with this setup? I'm testing now, will report any improvements on the 3D load later.

L.E: Tried a 40 minute episode. Everything seems the same in MPC-HC quality-wise, except the 3D load is 10% lower on average. MPV hits 70%, while MPC-HC barely hits 60%. This could be good news, but need to test further with a long movie, as the frame drops rarely occur in 40 minute episodes with MPV as well.

Update since response from @Chainik
Using MPV is similar to using MPC with MadVR so if you are just using MPC-HC then that's probably why you are getting a lower 3D load. Now that I've go MPC+Rife working with VapourSynth, I see that is almost as smooth as with MPV and if I hadn't discovered MPV I would be pretty happy. But I can't see me going back to using MPC when MPV is basically MPC+MadVR but with better picture quality and fewer micro-stutters with Rife.

dlr5668 wrote:

mpv can be too wild to config imo. Can you retest with MPC-HC ?

Both MadVR and MPV require a lot of reading but "by default" MadVR has a GUI while MPV does not. I'm new to MPV but I like the additional flexibility of the text file and the better picture quality. But MPV is easy to over-configure with lines of config that are not required. For the most part, leaving the basic commands at default works and then tweaking from there works best.


Xenocyde wrote:

I switched last night to V2 as per the tutorial posted above. I can't really notice much of a difference in smoothness on my RTX 3070 laptop GPU for 1080p content. Artifact handling seems a bit better maybe.

However, I still get the framerate drops that last around 10 seconds. These usually happen after 1 h or 20-30 minutes during 2h+ movies, very rarely in TV series episodes of ~40 minutes. The SVP index drops from 1 to 0.8-0.7 usually, sometimes lower, and the GPU 3D utilization in task manager jumps from 70-80% to 100% while RAM utilization sits sub 2 GB most of the times. This is happening in MPV by the way. I need to test with MPC-HC.

I moved away from MPC (with MadVR) because it was unusable with Rife. With MPV I get better performance, almost perfect smoothness, less artefacts and much better interpolated picture quality than with MPC/MadVR so I can never go back. With a 3070 laptop GPU you are always going to have issues but maybe with MPC it will work better for you.

Note: Edited to say "unusable" -> I moved away from MPC (with MadVR) because it was "unusable" with Rife.

Blackfyre wrote:

For the ones above, after testing yesterday, the quality with RIFE that comes with SVP is better than the v2 I updated to via the links above.

Current RIFE with SVP shows less artifacts for example on intros when names are showing up, and smoother overall.

rife_V2 is creating artifacts and the quality seems to drop as well on 4K content looking like 1080p, at least with my MPV settings.

Forgot to back up my vsmlrt.py and had to remove RIFE and add it back. Now picture quality and smoothness is back to being better.

By the way @Chainik, if it's possible to add a fourth option under maintenance called "Check File Integrity". So, it checks all the SVP files and replaces them with the default ones from SVP. Overriding any changes we make to RIFE or MPV folder, etc.

I think the v1/v2 debate may be dependant on local environment because I went back to v1 and didn't notice any improvements over v2. If anything it was slightly worse. Then I tried ensemble and the issues with the star field in Gravity became much worse. This scene seems to be Rife's Kryptonite. The same scene on Automatic has no issues.

I could have done with this info a few weeks ago smile But at least it made me go deeper and look into the code itself which has helped.

Fortune424 wrote:

12. The thing here that confused me is that you don't have to select the V2 model specifically. It seems like SVP chooses the V2 model automatically if the folder structure exists like that. So you'll be using the non-ensemble V2 rife 4.6 model by default if you have your thing set up like mine.

Yes I did comment on this a few weeks ago but I got not reply and in general I haven't been getting any replies from the devs. There is a single piece of "wrapper" code for all models. I'm not a Python person but it looks like it defaults to Rife V2  for the Tensor backend if the Rife v2 folder and onnyx models exist. Otherwise it defaults back to Rife V1.

I don't need it to be any better for smoothness and as I said before, it is mostly way better for artefacts. But I just wish there was some way to adjust for artefacts because it does sometimes introduce it's own kind of artefacts.

Blackfyre wrote:
UHD wrote:

If anyone is interested in much, much better quality than RIFE interpolation I will write about it soon, here on this forum. Please give me another week, maybe two weeks, until I update my repository on GitHub.

This is very exciting by the way. I don't know how anything can be better than RIFE, basically RIFE with better Artifact Masking for me is the ultimate goal (just artifact masking getting better and better). Because smoothness wise, RIFE is already insane, so I can't imagine better. Maybe efficiency? Because RIFE is very demanding.

I agree. Smoothness is practically a non issue now because Rife is so smooth and SVP with Rife has much fewer artefacts. But artefacts are still noticeable and in some cases Rife introduces artefacts that weren't there before. Like the one in Gravity which looks like someone pulling a dark coat a cross the stars in the background.

386

(11 replies, posted in Using SVP)

Blackfyre wrote:

Cleaned further (removed redundant settings for gpu-next), changed tone-mapping options to auto for better accuracy, removed all ewa_lanczossharp and changed them with ewa_lanczos as gpu-next makes the former useless and waste more energy for no reason.

Below configuration now runs better (performance improved compared to previous configurations):

In gpu-next, lanczos is basially the same as lanczossharp in GPU.

387

(11 replies, posted in Using SVP)

Blackfyre wrote:
dlr5668 wrote:

New dev rife build will also reduce lag on rewind to zero

Nice, can't wait for an update. It feels like I'm watching content in a completely new way now with RIFE.

Doubt we'll see it, but if performance improves to allow me to push 3x the framerate with my RTX 3090 that would be amazing.

Still don't know why Dolby Vision flickers with SVP on, and with RIFE the colours also wash out and blacks become dark grey, here is my current configuration:

vo=gpu-next

fbo-format=rgba16hf

gpu-api=vulkan
gpu-context=winvk

hwdec=nvdec

FBO doesn't work with gpu-next according to the gpu-next errata. It looks like you are using Windows and if so then there's no need for Vulkan and no need to set context either.

SVP says you are supposed to use a copy-back decoder but I've tried a non copy-back decoder and I'm not sure it's necessary now. But I leave it in because it is not affecting performance. Hopefully one of the devs like Chainik can clarify.

388

(11 replies, posted in Using SVP)

Blackfyre wrote:
dlr5668 wrote:

Rife kinda killed it (for video interpolation)

I haven't tried it in over a month. If the issue is fixed where it takes so long to open a 4K file, then I would use it without hesitation.

But the loading issues always put me off.

EDIT:

OKAY WOW THE DIFFERENCE IS MASSIVE!

Even at double the FPS (48FPS) it looks better than anything else at 120FPS.

It is worth the loading time and seek loading time when forwarding and moving back. Artifacts are minimal too. And now I wish my RTX 3090 could push 3x or 4x the framerate haha!

With Rife v2 I run 2160p movies at 60Hz with the occasional micro lag on my 3080 and I'm happy with that smile

Super4Jet wrote:

I've - just given up on re-installing SVP. Just doesn't work on my machine. It worked last time though, and I think there might be something fishy going on in the code regarding VM-Detection. Or it's just the lack of a physical GPU that's bothering the SVP Manager at startup. Either way it would require me to take a way more complicated approach than I would get with FlowFrames at the moment. Still, it isn't ideal, updating as a non-paying user also takes about half an hour which isn't great either. So I'll leave it be for now.
As for 4.6, I've just tested it with some black and white scenes and though I didn't compare to 4.4, it looks a lot better than v4. B&w seems to be really difficult for interpolation as it doesn't know where that specific dark spot came from, from above or from the side etc., whereas before it could just tell them apart by color.

Back to the original question: Since I think the same AI fed with the same image sequence will always return the same output, maybe cut out that scene, use a different RIFE version und paste it back in? A little complicated, I know, or you could just concede and stick with v4.4 for the whole movie? To me it doesn't look like a technical issue with neither SVP nor RIFE AI, just that the training data is always a bit different and sometimes just gets worse with an update in some areas. And v4.4 isn't vaaastly inferior to v4.6 imo...

Also, I'm well aware this is not a FlowFrames troubleshooting forum, but I'd be happy to help there if needed smile

Thanks but both 4.4 and 4.6 have the same issue. There are a few movies that require Rife's extra smoothness but Gravity seems smooth enough with Automatic. So if it bothers me too much I can go back to using Automatic for this one movie and use Rife for the rest. The conditional statements don't work properly in this case but it really isn't a major issue, just annoying.

Super4Jet wrote:

For me it was that every second frame was black, as in pitch-black, RGB #000000. I sadly don't have the video at hand anymore, wasn't worth the storage big_smile

This only happens with Gravity? You might want to try another RIFE-model, the most recent is v4.6 (afaik not in the current version of SVP), other good ones are plain v4 and v2.3. I'm not entirely sure if you have all these options, I'll probably have to spin up a VM and look which options are available.
Just for reference, you could also try Flowframes for once, the most recent precompiled version seems to already include RIFE AI v4. I'm not sure if 'recommending' competitors goes well here, so we'll see XD

Also I'm rate limited here, so I'm sorry my responses come in so slow... 2h/reply apparently

The 4.6 model is available in SVP and that's the version I use. The 4.4 model is a little worse. I had a look into that other matter you mentioned and I'm not sure it's better. The latest version doesn't seem to support audio plus unlike SVP there's no way to test it, no free trial etc. So why would I want to test a supposedly inferior version when SVP (with some glitches) works pretty well?

Whether I'm using Optical Flow or not, I get major flickering for some space scenes in Gravity when using Rife that I don't get on Automatic. It's similar to the effect you get when over sharpening.

Using MPV with Rife 2 is smooth so I didn't realize that I am regularly dropping "output" frames. My GPU is running at around 80% so I don't understand what the issue is?
I also found that the "ffdshow" parameter under Advanced Settings is set to "true". Is this correct?

dlr5668 wrote:
dawkinscm wrote:

Just updated to the latest pre-release TensorRT library. Start up time is now about 5 seconds and the seek is just shy of real time but very choppy so not worth the upgrade to the pre-release yet.

What do you mean start time? Once cached its below 2s for me

You may be right about caching but it seems to be a little variable for me sometimes.

Drakko01 wrote:
dawkinscm wrote:

Just updated to the latest pre-release TensorRT library. Start up time is now about 5 seconds and the seek is just shy of real time but very choppy so not worth the upgrade to the pre-release yet.

HI, I I like to try it, can you explain what I need to do for updating to the latest version. Thanks.

As I said, I don't recommend it because it caused some issues and I've ended up reinstalling SVP lol. Although thinking back on it, maybe some of that was my doing. Either way it works well enough with Rife v2. But if you insist then Google "v14 latest TensorRT library" smile

Just updated to the latest pre-release TensorRT library. Start up time is now about 5 seconds and the seek is just shy of real time but very choppy so not worth the upgrade to the pre-release yet.

Grinchy wrote:

Someone got it working with MadVR?

I'm using MPC-BE with MadVR and SVP Rife @ RTX 4080, but I cant get more than 1080p x2. 1080p 60fps would be perfect (120hz TV), but I get Framedrops with this.

Even while using TensorRT 4.6 with 2 GPU Cores it doesn't seems like the GPU works at full load. Taskmanager CUDA is always around 0% and the GPU itself won't go higher than 60-70%.

Anything i could do to get more performance? In the Guide it says to use Vapoursynth Filter. Will this even work with MadVR?

I got MPC-BE and MadVR working before with Vapoursynth but could not get a smooth 1080p/60 on my 3080 (although I think that might change with Rife v2). You want more performance, then switch to MPV where I was able to get a smooth 2160p/60 running at about 90% GPU. As I said in a previous post, the key for me was using 1 GPU thread. Any more than that then I started to run into issues but this has also improved with Rife v2.

I recently tried to get it working again with MPC-BE and Vapoursynth but it kept on crashing. I think it's to do with my Python install but I'm settled with the much better performance and picture quality of MPV so I haven't tried to hard to get it working again with MPC-BE and MadVR.

With Rife 2 I now get 4k/60 running at well below 90% GPU.

svr wrote:

Of course I use TensorRT, but for example, when the MPV player is running, this warning is displayed:

vstrt: TensorRT version mismatch, built with 2135 but loaded with 2136; continue but fingers crossed...

I used v1 version models that come as part of SVP. I also tried the 4.4 model, tried to turn off the boost, but still after a while the video driver crashes.

Display driver nvlddmkm stopped responding and has successfully recovered.

It looks like you have been tinkering with some back end files? Anyway, I hope the Devs can come up with a solution but if it was me I would uninstall the rife/Tensor RT stuff first. If that doesn't work then I would uninstall SVP completely before reinstalling it.

svr wrote:

I use 4 GPU threads. If I use only one, then my system starts to slow down.

Once you get it working I suggest you install rife v2. You might be able to reduce the number of GPU threads required.

svr wrote:

Tried this new feature. I really liked the quality. Even on my not-so-new PC with RTX3060, it works in realtime with 1080 video. But I have a problem. After 30-60 minutes, the video driver freezes with the following events:

The description for Event ID 0 from source nvlddmkm cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer.
Faulting application name: mpv.exe, version: 2.0.0.0, time stamp: 0x00000000
Faulting module name: nvinfer.dll, version: 0.0.0.0, time stamp: 0x638eab04
Exception code: 0xc0000409
Fault offset: 0x00000000046172f5
Faulting process id: 0x54
Faulting application start time: 0x01d954a7b9c628bd
Faulting application path: C:\Program Files (x86)\SVP 4\mpv64\mpv.exe
Faulting module path: C:\Program Files (x86)\SVP 4\rife\vsmlrt-cuda\nvinfer.dll

I tried different versions of video drivers, tried different players (MPV, MPC-HC, MPC-BE), the result is the same everywhere - it works well, but after a while it crashes.

I thought you might be running out of memory, but I'm running on a 3080 with 4GB less memory than the 3060. How many GPU threads are you using? With 8GB I've found that any more than 1 GPU thread takes up too much processing and memory. I assume that you are using the TensorRT engine? Also using rife v2 took my GPU processing below 90% while also removing the seek delays I had with rife.

I've added the v2 models and seeking peformance is massively improved. There is no longer any difference in seeking whether I'm using RIFE or not. But I'm a little confused because it works with my TensorRT engine as well even though there isn't a direct option to choose this AI model like there is for Vulkan.

Just as an aside, it's a pity that when using the Tensor engine, it has very noticeable artefacts when watching the movie Gravity with the stars in space. They shimmer like a black coat is being run across them. This doesn't happen on Vulkan or Automatic and it's annoying.

dlr5668 wrote:
Xenocyde wrote:
dlr5668 wrote:

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

Video Super Resolution support introduced today with the 531.18 drivers.

and its out. Here is mpc render for it https://github.com/emoose/VideoRenderer … ag/rtx-1.0

Very interesting.

But I use a separate media player when I want to upscale from a low quality source. I play movies mostly above HD resolution downscaled to HD which didn't  work well for me with RIFE using MPC-BE and MadVR. MPV does work well and allows me to render and scale to an even higher quality but at the cost of much higher GPU utilisation.