551 Reply by grobalt (edited by grobalt 10-01-2023 22:28:41)

  • Thanks: 14

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Chainik wrote:

> Can someone integrate the script in MPC Player to add MadVR in the pipeline ?

what do you mean? just run MPC-HC with 'Vapoursynth Filter' instead of 'Avisynth Filter'

I tried today ..

MPC-HC shows:
23:23:24.207 [E]: Playback [c85b13c2]: AVS - RIFE: failed to load model\n(C:\Users\patri\AppData\Roaming\SVP4\scripts\c85b13c2.avs, line 62)\n(C:\Users\patri\AppData\Roaming\SVP4\scripts\c85b13c2.avs, line 77)

I thought i could do this:
SVP menu -> Utilities -> Set environment variables for Vapoursynth

but this is not selectable, my SVP looks like this:

Post's attachments

vapoursynth.jpg, 107.51 kb, 602 x 580
vapoursynth.jpg 107.51 kb, 127 downloads since 2023-01-10 

552 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Mardon85 wrote:

Ok I got it working with a 4K SDR video. Wow brilliant stuff. I'm not sure if its working with HDR though. Its x2 frame rate but the HDR colours don't seem to be coming through.

Have you tried the following file in real time?

video test:
LG 4K HDR Demo - New York.ts.
3840x2160, HDR10, 25FPS
Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

Can you smoothly interpolate in real time with RIFE x2, without losing frames? How are the colours?

553 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:
UHD wrote:
aloola wrote:

My MPC-MC+MPC Video Render + Vapoursynth Filter works perfectly fine with RIFE. Better results than MPV.

Better results???

well at least for me
1080p@24 x4
MPC+MPC render: ~75% GPU load.
SVP's MPV default: ~85%

maybe different between users' setups.

This is puzzling. Apparently it is the mpv that is more efficient....

554 Reply by Pezede (edited by Pezede 10-01-2023 23:01:33)

  • Thanks: 19

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
Pezede wrote:

I've tried enabling and disabling and I'm not seeing any color differences.

For what it's worth even under 4K@25*3 I'm not seeing cuda use above 50% either...

Thank you!

Pezede, I think you have the perfect setup to test what really matters in the success of your interpolation.

I think with 4K HDR x3 in real time with RIFE, there is no point in playing around with encoding tests anymore.

What everyone is probably interested in is what the minimum configuration allows for:
1. 4K HDR x3 in real time with RIFE
2. 4K HDR x2 in real time with RIFE

My test proposal:

LG 4K HDR Demo - New York.ts
Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

1. Reduce only the TDP of GPU in steps of 10%

100%  4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
90% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
80% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
70% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
60% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
50% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

50% interests me personally, as I will be able to passively cool the graphics card to around 250W TDP

2. Reduce only the TDP of CPU in steps of 10%

100%  4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
90% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
80% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
70% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
60% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
50% 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

3. Reduce only the MHz of RAM in steps of 400 MHz

6000 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
5600 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
5200 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
4800 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
4400 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
4000 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time
3600 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

4800 MHz is of particular interest to me because this is currently the maximum with true ECC

I know this is probably too many tests, so maybe a simple 4 tests to start with and that will explain a lot from all of the above:

1.  GPU 50% TDP 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

2.  CPU 50% TDP (or 105W TDP or 65W TDP) 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

3. RAM 4800 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

4. RAM 3600 MHz 4K HDR x3 in real time pass or fail and if fail 4K HDR x2 in real time

Of course, it doesn't have to be today or tomorrow. It doesn't have to be anything at all. But I think you could help a lot of people to choose the optimal configuration for RIFE interpolation smile


Hey, I'm afraid that I don't really have the time to do those tests, it doesn't help that tinkering with ram on AM5 is far from a pleasant experience (I've tried)... sad

  • Thanks: 86

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

MPC-HC shows:
23:23:24.207 [E]: Playback [c85b13c2]: AVS - RIFE:

you're using Avisynth Filter instead of Vapoursynth Filter.


This is puzzling. Apparently it is the mpv that is more efficient....

producing the same FPS with a lower GPU load is more efficient, right? big_smile

556 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Pezede wrote:

Hey, I'm afraid that I don't really have the time to do those tests, it doesn't help that tinkering with ram on AM5 is far from a pleasant experience (I've tried)... sad

No problem. Thanks for the tests and I hope you will try to help other 4090 graphics card owners to replicate your real-time interpolation result smile

557 Reply by UHD (edited by UHD 10-01-2023 23:15:51)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:

producing the same FPS with a lower GPU load is more efficient, right? big_smile

In fact, yes... That's why it's worth testing different configurations. I'm curious to see if anyone else gets a similar effect. However, checking why this happens is unlikely to be easy.

558 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD Video Frame Interpolation Benchmarks

SVP, mpv, vs-mlrt (vstrt: TensorRT-based GPU Runtime), RIFE Model 4.6
LG 4K HDR Demo - New York.ts
3840x2160, HDR10, 25FPS
Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

4K HDR10 video playback with x3 RIFE interpolation in real time
PASS - RTX 4090, Ryzen 9 7950X, DDR5 6000 MHz – Pezede
https://www.svp-team.com/forum/viewtopi … 588#p81588

4K HDR10 video playback with x2 RIFE interpolation in real time
PASS - RTX 4090, Ryzen 9 5900X, DDR4 3800 MHz (OC) – DragonicPrime
https://www.svp-team.com/forum/viewtopi … 641#p81641

  • Thanks: 14

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Will do .. as soon as I get mpc-hc running

560 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

If anyone else manages to pass the above tests without losing frames let us know.

If I have made any mistake in the above post also let me know.

561 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

I ordered a case and components to test and make some comparisons
I will have

Ryzen 5600x with 3600 MHz Memory
Ryzen 7700x with 7200 MHz Memory
Intel 13600 KF with 7200 MHz Memory

RTX4090
RTX4080
RTX4070ti

if someone wants to provide some good input or prepared scripts for comparison, i am happy to use them smile

Can someone integrate the script in MPC Player to add MadVR in the pipeline ?

I will be looking forward to the tests and will have lots of questions wink

562 Reply by UHD (edited by UHD 10-01-2023 23:32:13)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Pezede, what size RAM do you have and how much did the RIFE use when interpolating x3 above 4K HDR video file?

DragonicPrime, what size RAM do you have and how much did the RIFE use when interpolating x2 above 4K HDR video file?

  • Thanks: 16
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:

Pezede, what size RAM do you have and how much did the RIFE use when interpolating x3 above 4K HDR video file?

DragonicPrime, what size RAM do you have and how much did the RIFE use when interpolating x2 above 4K HDR video file?

I have 32gb of ram. SVP and MPV combined only used around 4.2gb of ram

564 Reply by UHD (edited by UHD 11-01-2023 00:24:51)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

DragonicPrime wrote:
UHD wrote:

Pezede, what size RAM do you have and how much did the RIFE use when interpolating x3 above 4K HDR video file?

DragonicPrime, what size RAM do you have and how much did the RIFE use when interpolating x2 above 4K HDR video file?

I have 32gb of ram. SVP and MPV combined only used around 4.2gb of ram

Thanks, that's very good news smile

565 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:
UHD wrote:
Pezede wrote:

I've tried enabling and disabling and I'm not seeing any color differences.

For what it's worth even under 4K@25*3 I'm not seeing cuda use above 50% either...

Thank you!

Pezede, I think you have the perfect setup to test what really matters in the success of your interpolation.

I think with 4K HDR x3 in real time with RIFE, there is no point in playing around with encoding tests anymore.

What everyone is probably interested in is what the minimum configuration allows for:
1. 4K HDR x3 in real time with RIFE
2. 4K HDR x2 in real time with RIFE

My test proposal:

Your proposal to find the matching GPU does not work as the tensor cores are very different between the RTX cards ...

For me personally, there is no choice other than the RTX 4090. If only for one reason - in passive GPU cooling, die size is the most important factor:

GeForce RTX 4090 has 608.5 mm2
GeForce RTX 4080 has 378.6 mm2

The difference is significant. Here it is not possible, as in active cooling, to control the cooling by adjusting the fan speed.

I will be able to passively cool the GeForce RTX 4090 at around 250W TDP. I need the maximum contact area for heat transport away from the GPU. That is why I am particularly interested in this TDP value.

I suggested to Pezede this kind of testing as I assumed he would not have the option to change GPU, CPU and RAM for testing. This is the simplest test to see how the drop in performance of the various components in the setup affects performance. What can be saved on and what is not worth saving on.

  • Thanks: 1622
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:
UHD wrote:
aloola wrote:

My MPC-MC+MPC Video Render + Vapoursynth Filter works perfectly fine with RIFE. Better results than MPV.

Better results???

well at least for me
1080p@24 x4
MPC+MPC render: ~75% GPU load.
SVP's MPV default: ~85%

maybe different between users' setups.

different renderers

  • Thanks: 86
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

@Chainik

BTW it can generate a "multi-resolution" cache, for example one cache for "1920*1080 and below" but then the speed drops by ~30% hmm

look like they just fixed the bug https://github.com/AmusementClub/vs-mlrt/issues/20

568 Reply by Mardon85 (edited by Mardon85 11-01-2023 09:58:45)

  • Thanks: 13
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
Mardon85 wrote:

Ok I got it working with a 4K SDR video. Wow brilliant stuff. I'm not sure if its working with HDR though. Its x2 frame rate but the HDR colours don't seem to be coming through.

Have you tried the following file in real time?

video test:
LG 4K HDR Demo - New York.ts.
3840x2160, HDR10, 25FPS
Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

Can you smoothly interpolate in real time with RIFE x2, without losing frames? How are the colours?

I'll do some further tests today and report back.

For reference my system is a 10900k @ 5.2ghz all core 32gb of CL14 4000mhz ram (not sure if very low latency or bandwidth plays the bigger factor here). Also works at x3 resolution in HDR.

The 4090 is mind blowing like x2 generational leap over my 3090. It so frugal on energy too!

EDIT----

Ok i've tested this further. Through MPlayer HDR works with Standard SVP interpolation (but not Rife). However since brining in all the new RIFE updates it seems to have broken HDR in MPV player. Even when using standard interpolation with Rife off MVP/SVP player is not playing HDR (even when turned off). I've even tested MPV on its own without SVP and it is not displaying HDR colours. I've posted my config file below for info:

Any ideas?

------------------
#
# THIS FILE WILL BE OVERWRITTEN WITH THE PACKAGE UPDATE
# Use %APPDATA%/mpv/mpv.conf
# OR SVP's menu -> Information -> Add. information -> mpv config. file
#     to define your own customized configuration
#
# Sample mpv configuration
#

# this is required for SVP to "catch" the mpv
input-ipc-server=mpvpipe

# hardware video decoder
hwdec=auto-copy
hwdec-codecs=all

# high quality video output, require rather fast video card
#profile=gpu-hq

# D3D11 renderer (default) is required for the HDR playback
#gpu-api=d3d11

# use VULKAN API if you have problems with the default d3d11 renderer
#gpu-api=vulkan

# miscellaneous options

# comment this one if you want mpv to remember the playback position
save-position-on-quit=yes

# fixes audio desync
hr-seek-framedrop=yes

#log-file=mpv.log
# this is required for SVP to "catch" the mpv
input-ipc-server=mpvpipe
hwdec=nvdec-copy
#hwdec=auto-copy

vo=gpu-next

-----------------

FINAL EDIT --- Adding this here incase anyone has the same issue. I needed to add the following to the config file:

--vo=gpu-next --target-colorspace-hint=yes --gpu-api=d3d11

The image clip you provided now plays at 50fps in HDR and looks fantastic.

One very happy camper here. Thanks everyone for your effors.

  • Thanks: 13

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Interestingly I tried a 21:9 4h HDR video after the LG one at x3 and when in window mode it ran correctly. As soon as I double clicked to go full screen the film dropped to 9fps. Looks more like a configuration issue than RIFE as it was running fine windowed.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

if any additional mb/s of data transferred can break things then everything is possible

  • Thanks: 49

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:
Drakko01 wrote:
Chainik wrote:

> when I try to do this, access violation error appears and the player close

SVP menu -> Utilities -> Set environment variables for Vapoursynth

No change , same error , any ideas

thanks in advance

must be on your side, My MPC-MC+MPC Video Render + Vapoursynth Filter works perfectly fine with RIFE. Better results than MPV.

make sure there is no other vapoursynth path in your system PATH.

here is mine
https://media.discordapp.net/attachments/290709370600423424/1062486253313990697/image.png

Thanks for your  advice, delete other path in the variables
Now no error pop , but the player closed when open any movie.

  • Thanks: 13
  • Thanks for the post: 2

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

BTW I was returning my watercooled 3090 back to stock today before selling on. I thought i'd give this latest version of Rife a go and it does run 4K HDR at 48FPS no issue.

So this isn't limited to 40 series cards. Power draw is low too, around 150w.

573 Reply by Xenocyde (edited by Xenocyde 12-01-2023 19:23:42)

  • Thanks: 47

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Any idea how to increase workspace memory to allow for more tactics? Or do we ignore that warning?

  • Thanks: 230
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Xenocyde wrote:

Any idea how to increase workspace memory to allow for more tactics? Or do we ignore that warning?

edit this line

clip = RIFE(clip=clip, multi=interpMulti, model=RIFEModel.v4_6, backend=Backend.TRT(fp16=True, device_id=GPU, workspace=WS_size, use_cuda_graph=True, num_streams=GPU_t))

I think 2000 is enough for 4k

  • Thanks: 47

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:

edit this line

clip = RIFE(clip=clip, multi=interpMulti, model=RIFEModel.v4_6, backend=Backend.TRT(fp16=True, device_id=GPU, workspace=WS_size, use_cuda_graph=True, num_streams=GPU_t))

I think 2000 is enough for 4k

What file do I edit?