651 Reply by UHD (edited by UHD 25-02-2023 01:51:22)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Who wants to interpolate 4K HDR videos x5 in real time with RIFE?
Perhaps a more appropriate question is who can afford it?

After reading all the posts on this thread I come to the conclusion that it is possible, and the limitation is not the NVIDIA GeForce RTX 4090 graphics card but the RAM bandwidth.

For someone with unlimited financial resources this is the solution:

ASUS Pro WS W790E-SAGE SE motherboard
Intel Xeon W9-3495X processor
G.SKILL DDR5-6400 CL32-39-39-102 octa-channel R-DIMM memory modules

https://www.gskill.com/img/pr/2023.02.23-zeta-r5-rdimm-ddr5-announce/06-zeta-r5-rdimm-spec-table-eng.png
Source: https://www.gskill.com/community/150223 … erformance

The result?

303.76GB/s read, 227.37 GB/s write, and 257.82 GB/s copy speed in the AIDA64 memory bandwidth benchmark, as seen in the screenshot below:

https://www.gskill.com/img/pr/2023.02.23-zeta-r5-rdimm-ddr5-announce/04-zeta-r5-rdimm-ddr5-6400-c32-16gbx8-bandwidth.png
Source: https://www.gskill.com/community/150223 … erformance

Of course, the Intel Xeon W9-3495X is completely out of my reach....

The cheapest unlocked Intel Xeon would be the W5-2455X at a suggested price of $1039: https://www.anandtech.com/show/18741/in … -5-0-lanes Should be enough. If the current dual-channel DDR5-6000 allows x3 interpolation then the quad-channel DDR5-6400 should be enough for x5 real-time interpolation.

I am looking for someone who has an NVIDIA GeForce RTX 4090 graphics card, at least DDR5-6000 memory and some spare time to test how RIFE real-time interpolation scales at different RAM speeds.

Alternatively, someone who would like to build an HTPC based on quad-channel or octa-channel DDR5-6400 R-DIMM memory. Octa-channel is for the 4K 240Hz screens that will soon go on sale big_smile

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD

are you waiting for 5090 now?

653 Reply by Xenocyde (edited by Xenocyde 25-02-2023 15:31:31)

  • Thanks: 47

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Xenocyde wrote:

I've been noticing some drops in performance here and there, not sure what triggers this. The SVP index drops to half for several seconds and then it goes back up to full. Could this be a VRAM problem? I have an RTX 3070 mobile with 8 GB, performance boost enabled, but I did not deactivate GPU scheduling.

I disabled GPU scheduling, but still get the occasional drops. Btw, the index drops to ~0.8-0.9, not 0.5 as stated previously, yet it feels stuttery as hell. Also tried with 2 GPU threads instead of 4. Seemed like this solved the problem but I still got a stutter at some point... maybe it reduces the frequency of occurrence.

GPU scheduling did allow me to run SVP RIFE with lower wattage though. This means the GPU cooler is not in full load in overboost mode anymore so less noise. I can even run at full index on balanced mode (lowest power preset on my laptop) for 40-50 minute episodes, but the GPU starts to get too hot over 1+ h and failsafe maximum fan speeds kick in, so this does not really work for longer movies.

The MPV-lazy version lets me adjust these parameters if stutters start to happen:
if interpMulti == 3: maxIpps = 1.0 *
elif interpMulti == 6: maxIpps = 1.0 *

Is there something similar in the SVP implementation?

654 Reply by UHD (edited by UHD 25-02-2023 14:13:55)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Chainik wrote:

UHD

are you waiting for 5090 now?

I am waiting for Video Frame Interpolation enthusiasts who, like me, care about the highest possible interpolation quality. Those who believe that the growth of a community of people interested in Video Frame Interpolation based on Artificial Intelligence will also contribute to the development of interpolation methods and thus their quality.

When the first RIFE filter for VapourSynth appeared on 1 June 2021 the same day I asked about the possibility of implementing it into SVP: https://www.svp-team.com/forum/viewtopic.php?id=6196
Even your test that indicated 4fps for 1080p: https://www.svp-team.com/forum/viewtopi … 426#p78426 did not cool my enthusiasm. Even the lack of support at the time from others didn't faze me either. I know that these days most people expect ready-made solutions given on a platter.

4fps for 1080? Meh... next.

I, however, firmly believed at that time that real-time interpolation using Artificial Intelligence would be possible.

Today it is possible, even 4K HDR x3 in real time.

If the bottleneck in achieving 4K HDR x5 in real time is RAM then using quad-channel or octa-channel DDR5-6400 R-DIMM memory may help.

I am waiting for enthusiasts who has an NVIDIA GeForce RTX 4090 graphics card and at least DDR5-6000 memory who would like to help verify that the bottleneck is RAM.

One factor that might point to this are your own posts:

chainikdn wrote:

It's not about CPU load, it's about memory throughput. Increasing CPU threads may help.
Memory in a dual channel mode?

https://github.com/AmusementClub/vs-mlr … nt-4630846

chainikdn wrote:

Script-level / vapoursynth / mpv optimizations are out of scope here.

https://github.com/AmusementClub/vs-mlr … nt-4632772

chainikdn wrote:

Plus there're two more frames copying inside mpv - from mpv to vapoursynth and then back. Plus a copy-back video decoder, obviously.

https://github.com/AmusementClub/vs-mlr … nt-4633204

chainikdn wrote:

And I personally know how to make it even more gross and hacky big_smile and eliminate excessive frames copying back and forth, but I won't even make a PR for that, cause they will never accept it anyway....
But again, this is out of scope here.

https://github.com/AmusementClub/vs-mlr … nt-4634093

Chainik, if you could post here exactly how many times the video frames are copied back in RAM and what effect this might have on real-time 4K HDR x5 interpolation using RIFE then I would be very grateful.

If you have any idea how to reduce the number of copy operations in mpv and in vapoursynth then please post it in GitHub. I will support this idea and probably not only me. This is what I want to build a community of people interested in Artificial Intelligence in Video Frame Interpolation for.

This could eliminate the need for quad-channel or octa-channel DDR5-6400 R-DIMM memory or even NVIDIA GeForce RTX 5090!

4K 120Hz is standard on TV sets and monitors today so 4K HDR x5 interpolation could be very useful.

  • Thanks: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Chainik, can you implement the ensemble feature as well?

https://github.com/AmusementClub/vs-mlrt/discussions/24

I tried it already and it works with SVP, but maybe you can update SVP and include a switch for using it and the models too.

Btw.: I am using a 3080 and with Rife model 4.6Ensemble,  I got a load on cuda around 40-50% with 1080p 2x Interpolation.

656 Reply by dawkinscm (edited by dawkinscm 26-02-2023 17:23:07)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.

  • Thanks: 230
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

  • Thanks: 47
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:
dawkinscm wrote:

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

Video Super Resolution support introduced today with the 531.18 drivers.

  • Thanks: 86
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:
dawkinscm wrote:

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

since we're using vs-mlrt maybe we should include RealESRGANv2 to upscale 480p~720p? or maybe for transcoding.
https://github.com/AmusementClub/vs-mlr … alESRGANv2

660 Reply by dlr5668 (edited by dlr5668 28-02-2023 17:22:38)

  • Thanks: 230
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Xenocyde wrote:
dlr5668 wrote:
dawkinscm wrote:

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

Video Super Resolution support introduced today with the 531.18 drivers.

and its out. Here is mpc render for it https://github.com/emoose/VideoRenderer … ag/rtx-1.0

Not bad https://imgsli.com/MTU4Mzgx

661 Reply by dawkinscm (edited by dawkinscm 28-02-2023 22:26:31)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dlr5668 wrote:
Xenocyde wrote:
dlr5668 wrote:

Nvidia should release soon https://www.youtube.com/watch?v=XA-tQpQqD7U Perfect match for Rife

Video Super Resolution support introduced today with the 531.18 drivers.

and its out. Here is mpc render for it https://github.com/emoose/VideoRenderer … ag/rtx-1.0

Very interesting.

But I use a separate media player when I want to upscale from a low quality source. I play movies mostly above HD resolution downscaled to HD which didn't  work well for me with RIFE using MPC-BE and MadVR. MPV does work well and allows me to render and scale to an even higher quality but at the cost of much higher GPU utilisation.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dawkinscm wrote:

I've been trying for a while now to get RIFE running smoothly with my 3080 with MPC-BE. I've given up on that so instead I tried using MPV and there was an instant improvement. It still needed a bit of work and I had to learn about MPV config files so that I could configure it to match the scaling used in my MadVR config. Now it looks great and runs very smoothly.


does fluidification work well with your madvr and 3080?

but not with RIFE?

  • Thanks: 13
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:

Who wants to interpolate 4K HDR videos x5 in real time with RIFE?
Perhaps a more appropriate question is who can afford it?

After reading all the posts on this thread I come to the conclusion that it is possible, and the limitation is not the NVIDIA GeForce RTX 4090 graphics card but the RAM bandwidth.

For someone with unlimited financial resources this is the solution:

ASUS Pro WS W790E-SAGE SE motherboard
Intel Xeon W9-3495X processor
G.SKILL DDR5-6400 CL32-39-39-102 octa-channel R-DIMM memory modules

https://www.gskill.com/img/pr/2023.02.23-zeta-r5-rdimm-ddr5-announce/06-zeta-r5-rdimm-spec-table-eng.png
Source: https://www.gskill.com/community/150223 … erformance

The result?

303.76GB/s read, 227.37 GB/s write, and 257.82 GB/s copy speed in the AIDA64 memory bandwidth benchmark, as seen in the screenshot below:

https://www.gskill.com/img/pr/2023.02.23-zeta-r5-rdimm-ddr5-announce/04-zeta-r5-rdimm-ddr5-6400-c32-16gbx8-bandwidth.png
Source: https://www.gskill.com/community/150223 … erformance

Of course, the Intel Xeon W9-3495X is completely out of my reach....

The cheapest unlocked Intel Xeon would be the W5-2455X at a suggested price of $1039: https://www.anandtech.com/show/18741/in … -5-0-lanes Should be enough. If the current dual-channel DDR5-6000 allows x3 interpolation then the quad-channel DDR5-6400 should be enough for x5 real-time interpolation.

I am looking for someone who has an NVIDIA GeForce RTX 4090 graphics card, at least DDR5-6000 memory and some spare time to test how RIFE real-time interpolation scales at different RAM speeds.

Alternatively, someone who would like to build an HTPC based on quad-channel or octa-channel DDR5-6400 R-DIMM memory. Octa-channel is for the 4K 240Hz screens that will soon go on sale big_smile

I have 6400mhz Dual Rank 64gb Sticks at netting just under 100Gb/s with a latency of 54Ns. Using MPV player i can't interpolate a 21:9 4k HDR film at 3x (13700k @ 5.6Ghz all core 4.5Ghz E cores).

664 Reply by UHD (edited by UHD 02-03-2023 22:05:38)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Mardon85 wrote:

I have 6400mhz Dual Rank 64gb Sticks at netting just under 100Gb/s with a latency of 54Ns. Using MPV player i can't interpolate a 21:9 4k HDR film at 3x (13700k @ 5.6Ghz all core 4.5Ghz E cores).

You've been away from us for a month and a half. Nice to see you Mardon85 again smile

NVIDIA GeForce RTX 4090 graphics card and DDR5-6400 memory is an excellent set up to test the capabilities of RIFE. It's a bit puzzling that you can't achieve x3 interpolation, especially since if I understood one of your earlier posts correctly, for x2 interpolation the NVIDIA GeForce RTX 3090 graphics card was completely sufficient.

Mardon85 wrote:

BTW I was returning my watercooled 3090 back to stock today before selling on. I thought i'd give this latest version of Rife a go and it does run 4K HDR at 48FPS no issue.

So this isn't limited to 40 series cards. Power draw is low too, around 150w.

https://www.svp-team.com/forum/viewtopi … 686#p81686

Write more about the test parameters:

1 What is your maximum refresh rate of your monitor or TV set? 100Hz? 120Hz?
2 Are you using G-Sync or FreeSync automatic refresh rate change?
3. Do you use the same settings that earl088 used successfully for x3 interpolation?
https://www.svp-team.com/forum/viewtopi … 799#p81799
4. Do you use the "Hardware-accelerated GPU scheduling OFF" setting that aloola suggests for improved performance?
https://www.svp-team.com/forum/viewtopi … 819#p81819
5. Write something more about the 21:9 4k HDR movie you are testing. Is it a 3840x2160 23.976FPS file with black bars at the bottom and top or does it have a different resolution and FPS?
6. Using the file below, can't you interpolate in real time x3?
LG 4K HDR Demo - New York.ts.
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS.
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits.

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

At the moment we need to find a way for you to be able to interpolate 4K HDR x3 in real time like others with NVIDIA GeForce RTX 4090 graphics cards.

If that works, then we'll try x4. I've got some new ideas for performance enhancements that haven't come up here yet for nowwink

665 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:

since we're using vs-mlrt maybe we should include RealESRGANv2 to upscale 480p~720p? or maybe for transcoding.
https://github.com/AmusementClub/vs-mlr … alESRGANv2

Soon we will have something better. Much better. Something that is much better suited to quality improvement for Video Frame Interpolation enthusiasts. I looked through literally hundreds of academic papers and found what I was looking for. It appeared literally a few months ago. As of yet there is no code for this paper, but the author assures that there will be. I will need the support of everyone on this forum to get this into vs-mlrt and then into SVP. The quality will be unattainable for RIFE even with RealESRGAN or any other SR method for live-action movies.

Give me a month until I sort out my repository on GitHub - I'll describe everything in detail based on these academic papers and this one most important one. For now, there is only a preprint and I think the author is waiting with publishing the code until the paper is accepted for publication. So we still have time.

666 Reply by DragonicPrime (edited by DragonicPrime 04-03-2023 08:03:23)

  • Thanks: 16
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
Mardon85 wrote:

I have 6400mhz Dual Rank 64gb Sticks at netting just under 100Gb/s with a latency of 54Ns. Using MPV player i can't interpolate a 21:9 4k HDR film at 3x (13700k @ 5.6Ghz all core 4.5Ghz E cores).

You've been away from us for a month and a half. Nice to see you Mardon85 again smile

NVIDIA GeForce RTX 4090 graphics card and DDR5-6400 memory is an excellent set up to test the capabilities of RIFE. It's a bit puzzling that you can't achieve x3 interpolation, especially since if I understood one of your earlier posts correctly, for x2 interpolation the NVIDIA GeForce RTX 3090 graphics card was completely sufficient.

Mardon85 wrote:

BTW I was returning my watercooled 3090 back to stock today before selling on. I thought i'd give this latest version of Rife a go and it does run 4K HDR at 48FPS no issue.

So this isn't limited to 40 series cards. Power draw is low too, around 150w.

https://www.svp-team.com/forum/viewtopi … 686#p81686

Write more about the test parameters:

1 What is your maximum refresh rate of your monitor or TV set? 100Hz? 120Hz?
2 Are you using G-Sync or FreeSync automatic refresh rate change?
3. Do you use the same settings that earl088 used successfully for x3 interpolation?
https://www.svp-team.com/forum/viewtopi … 799#p81799
4. Do you use the "Hardware-accelerated GPU scheduling OFF" setting that aloola suggests for improved performance?
https://www.svp-team.com/forum/viewtopi … 819#p81819
5. Write something more about the 21:9 4k HDR movie you are testing. Is it a 3840x2160 23.976FPS file with black bars at the bottom and top or does it have a different resolution and FPS?
6. Using the file below, can't you interpolate in real time x3?
LG 4K HDR Demo - New York.ts.
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS.
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits.

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

At the moment we need to find a way for you to be able to interpolate 4K HDR x3 in real time like others with NVIDIA GeForce RTX 4090 graphics cards.

If that works, then we'll try x4. I've got some new ideas for performance enhancements that haven't come up here yet for nowwink

I just tried it myself and I can't do x3 either with a 4090. I only have DDR4 ram at 3600MHZ, but it doesn't seem to be the problem. On that test video, at 3x interpolation, my 4090 is maxed out at 100% usage. at 2x with the recommended settings, it's at around 70% usage

  • Thanks: 86
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

I think 3070ti is the minimum to do 4k@25 x2. My gpu is >90% most of time.
https://cdn.discordapp.com/attachments/290709370600423424/1081170882828963850/image.png

  • Thanks: 13
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
Mardon85 wrote:

I have 6400mhz Dual Rank 64gb Sticks at netting just under 100Gb/s with a latency of 54Ns. Using MPV player i can't interpolate a 21:9 4k HDR film at 3x (13700k @ 5.6Ghz all core 4.5Ghz E cores).

You've been away from us for a month and a half. Nice to see you Mardon85 again smile

NVIDIA GeForce RTX 4090 graphics card and DDR5-6400 memory is an excellent set up to test the capabilities of RIFE. It's a bit puzzling that you can't achieve x3 interpolation, especially since if I understood one of your earlier posts correctly, for x2 interpolation the NVIDIA GeForce RTX 3090 graphics card was completely sufficient.

Mardon85 wrote:

BTW I was returning my watercooled 3090 back to stock today before selling on. I thought i'd give this latest version of Rife a go and it does run 4K HDR at 48FPS no issue.

So this isn't limited to 40 series cards. Power draw is low too, around 150w.


https://www.svp-team.com/forum/viewtopi … 686#p81686

Write more about the test parameters:

1 What is your maximum refresh rate of your monitor or TV set? 100Hz? 120Hz? 3440x1440 175hz HDR
2 Are you using G-Sync or FreeSync automatic refresh rate change? - Gsync
3. Do you use the same settings that earl088 used successfully for x3 interpolation? I NEED TO CHECK THIS AND REPORT BACK
https://www.svp-team.com/forum/viewtopi … 799#p81799
4. Do you use the "Hardware-accelerated GPU scheduling OFF" setting that aloola suggests for improved performance? I use it on due to gaming on system also.
https://www.svp-team.com/forum/viewtopi … 819#p81819
5. Write something more about the 21:9 4k HDR movie you are testing. Is it a 3840x2160 23.976FPS file with black bars at the bottom and top or does it have a different resolution and FPS? I scale everything down to by 21:9 screen so the black bars are completely gone and my entire screen is filled.
6. Using the file below, can't you interpolate in real time x3? I NEED TO CHECK THIS AND REPORT BACK
LG 4K HDR Demo - New York.ts.
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS.
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits.

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

At the moment we need to find a way for you to be able to interpolate 4K HDR x3 in real time like others with NVIDIA GeForce RTX 4090 graphics cards.

If that works, then we'll try x4. I've got some new ideas for performance enhancements that haven't come up here yet for nowwink

I've filled in some clarifications above.

669 Reply by UHD (edited by UHD 03-03-2023 16:52:44)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Mardon85 wrote:

I've filled in some clarifications above.

Thanks for the additional information.

175hz HDR
great, we have a big room to test

3440x1440
this probably shouldn't be a problem if scaling is done inside the monitor

Gsync
great, automatic adjustment

I NEED TO CHECK THIS AND REPORT BACK
OK

I use it on due to gaming on system also.
This means it would be worth checking if things improve with OFF. You can always easily go back to on

I scale everything down to by 21:9 screen so the black bars are completely gone and my entire screen is filled.
So the original file is full 4K. If any scaling is done in RAM then this can be an extra strain on RAM bandwidth. It would be good to have some 4K HDR file already in about 21:9 format for comparison that doesn't need to be scaled.

I NEED TO CHECK THIS AND REPORT BACK
OK

670 Reply by UHD

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Thanks for the test aloola smile

Please write what kind of CPU you have and at what frequency the RAM is running.

Knowing the performance of graphics cards:

Fourth-generation Tensor Cores - Peak FP16 using the Sparsity feature:

660.6 TFLOPS - NVIDIA GeForce RTX 4090
https://images.nvidia.com/aem-dam/Solut … ecture.pdf

Third-Generation Tensor Cores - Peak FP16 using the Sparsity feature:

174 TFLOPS - NVIDIA GeForce RTX 3070 Ti
https://www.anandtech.com/show/17204/nv … more-money


NVIDIA GeForce RTX 4090 has 3.80x more processing power!!!!!

This means that we should easily get x4 interpolation and be very close to x5 for 4K HDR. Clearly the bottleneck is not the performance of the Tensor Cores.

671 Reply by UHD (edited by UHD 03-03-2023 18:14:15)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

DragonicPrime wrote:

I just tried it myself and I can't do x3 either with a 4090. I only have DDR4 ram at 3800MHZ, but it doesn't seem to be the problem. On that test video, at 3x interpolation, my 4090 is maxed out at 100% usage. at 2x with the recommended settings, it's at around 70% usage

This is puzzling. 3.8x more power and the GPU load drops to only 70% compared to 90% for the 3070 Ti. If you've applied the tips above and still nothing, then I guess you'll have to compare step by step with those who have managed to interpolate x3 in real time.

Same video file - the LG demo I suggested and encoding to start with. Write how many FPS you have for RIFE interpolation. We will compare the FPS of the encoding first. In the next post I will give further, my ideas and we will see how they will affect the FPS.

  • Thanks: 16

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
DragonicPrime wrote:

I just tried it myself and I can't do x3 either with a 4090. I only have DDR4 ram at 3800MHZ, but it doesn't seem to be the problem. On that test video, at 3x interpolation, my 4090 is maxed out at 100% usage. at 2x with the recommended settings, it's at around 70% usage

This is puzzling. 3.8x more power and the GPU load drops to only 70% compared to 90% for the 3070 Ti. If you've applied the tips above and still nothing, then I guess you'll have to compare step by step with those who have managed to interpolate x3 in real time.

Same video file - the LG demo I suggested and encoding to start with. Write how many FPS you have for RIFE interpolation. We will compare the FPS of the encoding first. In the next post I will give further, my ideas and we will see how they will affect the FPS.

Well I don't think the fps I get when encoding will be of much help, since it doesn't make any sense. I'm only getting 18fps for some reason, even though I'm easily able to watch that same video in real time at 2x which means it's 50fps

673 Reply by UHD (edited by UHD 03-03-2023 19:51:56)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

It looks like there is a problem and a serious one at that. I guess I can't help you any more than to advise you to install the GPU drivers cleanly and reinstall SVP from scratch as well.

3070 Ti:
https://www.svp-team.com/forum/viewtopi … 819#p81819

  • Thanks: 16

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:

It looks like there is a problem and a serious one at that. I guess I can't help you any more than to advise you to install the GPU drivers cleanly and reinstall SVP from scratch as well.

3070 Ti:
https://www.svp-team.com/forum/viewtopi … 819#p81819

Tried to do both. Same result. Not sure what's wrong

  • Thanks: 86
  • Thanks for the post: 1

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

DragonicPrime wrote:

Tried to do both. Same result. Not sure what's wrong

try to use AIDA64 to benchmark your DDRAM first.
https://cdn.discordapp.com/attachments/290709370600423424/1081482725715873792/image.png