I switched last night to V2 as per the tutorial posted above. I can't really notice much of a difference in smoothness on my RTX 3070 laptop GPU for 1080p content. Artifact handling seems a bit better maybe.

However, I still get the framerate drops that last around 10 seconds. These usually happen after 1 h or 20-30 minutes during 2h+ movies, very rarely in TV series episodes of ~40 minutes. The SVP index drops from 1 to 0.8-0.7 usually, sometimes lower, and the GPU 3D utilization in task manager jumps from 70-80% to 100% while RAM utilization sits sub 3 GB most of the times. This is happening in MPV by the way. I need to test with MPC-HC.

UHD wrote:

If anyone is interested in much, much better quality than RIFE interpolation I will write about it soon, here on this forum. Please give me another week, maybe two weeks, until I update my repository on GitHub.

Oh? Patiently waiting for your post now...

Criptaike wrote:

Hello, so I've wanted to try the rife engine, the vulkan version works fine, but I sure want the tensorRT version, so when selecting rife after opening a movie, a cmd window pops up and mpc-hc crashes, it just goes to shit and it doesn't really say that there's an error or something, try to search the problem on google and this forum and no luck. Here is a gif of all that happening -> https://imgur.com/a/VHVCvBZ

Any ideas on what's happening? The vulkan one works.

Thanks

Need to wait for 3-4 minutes every time that cmd window pops up.

Mardon85 wrote:

My SVP settings are as follows:

https://i.imgur.com/SBPaBcz.png

What is this user defined option with Tensor RT?

dlr5668 wrote:
dawkinscm wrote:

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

Video Super Resolution support introduced today with the 531.18 drivers.

Xenocyde wrote:

I've been noticing some drops in performance here and there, not sure what triggers this. The SVP index drops to half for several seconds and then it goes back up to full. Could this be a VRAM problem? I have an RTX 3070 mobile with 8 GB, performance boost enabled, but I did not deactivate GPU scheduling.

I disabled GPU scheduling, but still get the occasional drops. Btw, the index drops to ~0.8-0.9, not 0.5 as stated previously, yet it feels stuttery as hell. Also tried with 2 GPU threads instead of 4. Seemed like this solved the problem but I still got a stutter at some point... maybe it reduces the frequency of occurrence.

GPU scheduling did allow me to run SVP RIFE with lower wattage though. This means the GPU cooler is not in full load in overboost mode anymore so less noise. I can even run at full index on balanced mode (lowest power preset on my laptop) for 40-50 minute episodes, but the GPU starts to get too hot over 1+ h and failsafe maximum fan speeds kick in, so this does not really work for longer movies.

The MPV-lazy version lets me adjust these parameters if stutters start to happen:
if interpMulti == 3: maxIpps = 1.0 *
elif interpMulti == 6: maxIpps = 1.0 *

Is there something similar in the SVP implementation?

I've been noticing some drops in performance here and there, not sure what triggers this. The SVP index drops to half for several seconds and then it goes back up to full. Could this be a VRAM problem? I have an RTX 3070 mobile with 8 GB, performance boost enabled, but I did not deactivate GPU scheduling.

Piovasia wrote:

Could someone share me the generate.js and base.py file, please ?  (╯•﹏•╰)

Go to this page and find Chainik's post with red text warnings (towards the top of the page). It has those 2 files.

cemaydnlar wrote:

On tensor rife 4.6 %15 scene change threshold i get lag on fast panning scenes just like on vulkan 4.4 with %10 scene change threshold. My gpu usage is around %50-55. Is there a solution for this ?

We basically need this

constasmile wrote:

Chainik, please try implement new ai scene detection from https://github.com/styler00dollar/VSGAN … detection. I use this fragment from Mad Max for tests how scene detection algorithms working https://drive.google.com/file/d/1f7zZ_A … share_link and this new thing performed almost perfectly.

Maybe Chainik can implement it sooner rather than later.

I reinstalled SVP to test the latest Rife TRT stuff. First thing I notice is that there is only model 4.4. When I play a video in 1080p I get 0.57 out of 1 on the SVP index graph. What am I missing here? I'm back in the exact same spot I was before installing the test pack released on Jan 9. That pack was working fine.

LE: Ah my bad, had to switch to TRT from the first menu.

LLE: What does that dynamic shapes option do? If I leave it on, I see stuttering, even though the SPV index is at 1.

Chainik wrote:

SVP updated, added TensorRT (no need for doing anything manually), fixed (??) possible audio desync after RIFE transcoding (both Vulkan and TRT versions)

Either select the checkbox at install time, or install an additional package called "TensorRT" via SVP menu -> Utilities -> Additional programs and features.

----
It uses "dynamic shapes" by default, i.e. only ONE optimization pass for all resolutions below 2560*1440. And if/when you open a 4K video then it'll do another pass for resolutions from 1440p to 4K.
BUT! this can be a little bit slower than optimization for a specific resolution, like 5% in my case. This is why there's a "performance boost" profile option - it forces its own opt. pass for each resolution.

another finding: model 4.6 needs more than 8G of device memory for 4K res, so if you're on a 8G card and want 4K then choose model 4.4.

----
Also installation scripts fixed so the Vapoursynth Filter must be registered automatically.

Do we need this update if we already have the test pack you posted on Jan 9?

Chainik wrote:

"workspace" is deprecated, should be set to "None"

Ya but what file do I need to edit?

dlr5668 wrote:

edit this line

clip = RIFE(clip=clip, multi=interpMulti, model=RIFEModel.v4_6, backend=Backend.TRT(fp16=True, device_id=GPU, workspace=WS_size, use_cuda_graph=True, num_streams=GPU_t))

I think 2000 is enough for 4k

What file do I edit?

Any idea how to increase workspace memory to allow for more tactics? Or do we ignore that warning?

constasmile wrote:
Chainik wrote:

>
dunno, I don't see any real problem with the current simple and fast method
another neural network just for a scene change detection looks like an overkill to me

Just try transcoding that clip from Mad Max. SCDetection works very bad. To avoid freezes, you need set more than 15%, I set 20%. At 15%, there are still freezes. But at high values,  ends of scenes are no longer detected at all and they simply flow one into another. It looks bad. I just want quality, not just work. I think I'm not the only one. By the way, when I tested, the difference with and without this system was no more than 10%. Fast scenes go with fading, part of scenes flow into one another, this is all work that does SCDetect.

I second this! Really don't like how SCD works above 6%. The changes are too flowy, but at 6% I get weird stuttering in some fast movement scenes. If it's not too complicated to implement the new method, please add it when you have time @Chainik.

I did some more testing, 10% scene change threshold seems a bit too much so I reduced it to 6%, but with this setting I'm seeing some stuttering on fast movement and sometimes on scenes with normal movement. Most of the times it disappears when I replay the scene, but sometimes the stutter persists even after replaying a few times.

grobalt wrote:

I deleted SVP and startet from scratch, just to check if the inscructions are complete and everything is working.
There is a step missing.
After replacing generate.js and base.py, start SVP4, add the new option TensorRT etc.

Then the missing step:
Copy the Rife AI profile and select the AI Model "rife"
Enable the new Option TensorRT On

Alrighty, this worked! Now it looks as smooth as with mpv-lazy, might be smoother looking at what you guys are saying, but cannot check since I am capped at 1080@60.

aloola wrote:
Xenocyde wrote:
Chainik wrote:

> Grobalt said 1080p real-time should be ok on RTX 3070 laptop GPU

not sure what you're doing, but it's OK even on a 2060 laptop now big_smile

Well, what should I do? Reinstall SVP + MPV + Rife support and redo the installation for the new TRT stuff?

maybe you follow VSRIFE guide, and not vsmltrt guide

uninstall SVP and follow the guide
https://www.svp-team.com/forum/viewtopi … 483#p81483

I reinstalled SVP, I did the TRT update, and now real-time interpolation does not even start. Well actually I do not know how to do this part: Make a copy of the RIFE video profile, one with TensorRT ON and another with OFF.

So I reinstalled everything and now the SVP index shows N/A and I did not get any window pop up to wait 3 minutes before it calculates stuff. Not sure what I'm doing wrong.

Chainik wrote:

> Grobalt said 1080p real-time should be ok on RTX 3070 laptop GPU

not sure what you're doing, but it's OK even on a 2060 laptop now big_smile

Well, what should I do? Reinstall SVP + MPV + Rife support and redo the installation for the new TRT stuff?

Chainik wrote:

updated instructions

should improve FPS on 4080-and-better (probably 4070 too, dunno), when performance is bound by the system's RAM bandwidth, not GPU power
i.e. for 4K playback

I have 32 GB DDR4-3200 RAM and trying to do real-time for 1080p. Grobalt said 1080p real-time should be ok on RTX 3070 laptop GPU. I can run things smoothly on mvp-lazy.

Chainik wrote:

don't do "fixed 60 fps" with RIFE

Switched to "To Screen" , Movie X2/3/4, still getting 0.75 and sound is lagging.

Realized that I need to be in the RIFE video profile. So I switched to RIFE, I activate it with the new ON/OFF switch, a window pops up with some processes, after 3 minutes it's done and... it's not working properly. I'm getting 0.75 out of 1 and sound is lagging.

grobalt wrote:

https://www.svp-team.com/forum/viewtopi … 483#p81483
and copy the onnx moel in the correct folder
you need put the *.onnx files here C:\Program Files (x86)\SVP 4\rife\models\rife

I followed the steps, think I did everything I was supposed to, but somehow this implementation does not seem as smooth as the mvp-lazy one. I get almost no contour artifacts for sure, but I can still see some sort of "ghost" trails and smoothness seems a bit off too. Maybe something is wrong on my side? As you can see the TensorRT is part of the Automatic profile, not sure if that's right.

grobalt wrote:

Depends on your resolution .. 1080p runs without any problem .. 2k as well ... 4k is still not fast enough

I have an RTX 3070 145 W and only have a 1080p TV.

Chainik wrote:

=== RIFE / PyTorch+TensorRT installation ===

!!! UPDATED 07-01-2023 !!!
- replaced base.py : fp16 isntead of fp32
+ added fix for vsrife
============

!!! Advanced users only, if you don't know what this is all about - you don't need it !!!

0. Update SVP via online updater (this will update Python to ver. 3.10.9)

1. Dependencies installation:
--------------
Download TensorRT libs: https://github.com/HolyWu/vs-rife/relea … 2_win64.7z
unpack CUDA-blah-blah.7z to SVP 4\mpv64

run cmd as Administrator

cd SVP 4\mpv64

python get-pip.py

python -m pip install torch torchvision --extra-index-url https://download.pytorch.org/whl/cu117
python -m pip install tensorrt-8.5.2.2-cp310-none-win_amd64.whl
python -m pip install torch-tensorrt-fx-only tqdm
python -m pip install -U --no-deps vsrife
python -m vsrife

A quick fix for vsrife's "slowmo" bug: replace __init__.py in SVP 4\mpv64\Lib\site-packages\vsrife\


2. SVP modification
---------------
Replace SVP 4\script\generate.js and base.py with the attached ones

menu -> Applications settings -> Additional options -> All settings, go to 'User defined options'
Title: TensortRT; Script name: rife_trt; Other values by default - "FRC profile", "ON or OFF"
Click 'Add option'

Go to the RIFE video profile, see the added TensortRT on/off swtich.
Make a copy of the RIFE video profile, one with TensorRT ON and another with OFF.

----------------
For a given video resolution the first-time start is super-slow (while it generates TRT net in a cache folder --> %APPDATA%\SVP4\cache\trt), so better do it in a "transcoding" mode.

Do I follow this guide? Or is there a more updated one?