476

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

I deleted SVP and startet from scratch, just to check if the inscructions are complete and everything is working.
There is a step missing.
After replacing generate.js and base.py, start SVP4, add the new option TensorRT etc.

Then the missing step:
Copy the Rife AI profile and select the AI Model "rife"
Enable the new Option TensorRT On


This is a good solution. Start from scratch and describe all the steps that are missing.

In other words, create some instruction for a completely new person so that they do not get lost.

477 (edited by UHD 09-01-2023 20:59:00)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

DragonicPrime wrote:

Just tried the updated instructions. Getting around 50fps at 4k with an RTX 4090 now. Between 170-190fps(it kept going up and down for some reason) at 1080p. These improvements are huge. Thanks for updating the instructions

Could you check if the video below can now be interpolated in real time with RIFE?
Second question: is it possible to preserve the 10 bit colour depth and HDR when interpolating in real time with RIFE the video below?
In other words, could you compare the colours of the video below played back without interpolation and with RIFE interpolation.

LG 4K HDR Demo - New York.ts
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

will do this soon .. currently generating the engine files for 4k/UHD resolution

479

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

will do this soon .. currently generating the engine files for 4k/UHD resolution

If you can please also test this file that I ask DragonicPrime in the above post. I'm very curious, as I'm also planning to buy a 4090 graphics card. If two people succeed, it will be the best confirmation of the capabilities of these highest performance graphics cards.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
DragonicPrime wrote:

Just tried the updated instructions. Getting around 50fps at 4k with an RTX 4090 now. Between 170-190fps(it kept going up and down for some reason) at 1080p. These improvements are huge. Thanks for updating the instructions

Could you check if the video below can now be interpolated in real time with RIFE?
Second question: is it possible to preserve the 10 bit colour depth and HDR when interpolating in real time with RIFE the video below?
In other words, could you compare the colours of the video below played back without interpolation and with RIFE interpolation.

LG 4K HDR Demo - New York.ts
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

4k HDR still doens't work in real time. I just updated my previous message as well. 4K SDR seems to work with no problems in real time though. 4K with HDR, I only get around 35-40fps

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

holy!! I CAN DO 1080p x4 IN REAL-TIME with 3070ti!!!!!!!!!!

https://media.discordapp.net/attachments/290709370600423424/1062115251786612776/image.png?width=697&height=545



btw:also maybe it a bug? every time black bar detection was on, the TRT CMD pop out again.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

aloola wrote:

holy!! I CAN DO 1080p x4 IN REAL-TIME with 3070ti!!!!!!!!!!

https://media.discordapp.net/attachments/290709370600423424/1062115251786612776/image.png?width=697&height=545



btw:also maybe it a bug? every time black bar detection was on, the TRT CMD pop out again.

that sounds about right. At 4x in real time, my 4090 is at around 35-45% usage so 4x for a 3070ti makes sense I think

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
grobalt wrote:

will do this soon .. currently generating the engine files for 4k/UHD resolution

If you can please also test this file that I ask DragonicPrime in the above post. I'm very curious, as I'm also planning to buy a 4090 graphics card. If two people succeed, it will be the best confirmation of the capabilities of these highest performance graphics cards.

just make sure you also have a good cpu, because at 4k in real time, my cpu usage is also much higher. With HDR, both cpu and GPU are close to 100%. I have a ryzen 9 5900X

484 (edited by grobalt 09-01-2023 21:28:32)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

What alola wrote the last days has just be to wrong .. impossible the results for his 3070ti with the old script.

DragonicPrime is something odd as well.
I can go MPV HDR on and OFF (Try to recover HDR colors) with frame doubling without dropped frames with a 5600x and RTX4090.

Now i need to figure out how to get that stuff integrated into a MadVR Player smile

The LG Demo File is lagging (about 2900 dropped frames at output for the full clip), 3 Rife Threads. No performance difference HDR on and off setting.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

dont understand why the LG file is causing issues

Post's attachments

hdr10.png 298.44 kb, 55 downloads since 2023-01-09 

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

What alola wrote the last days has just be to wrong .. impossible the results for his 3070ti with the old script.


I dunno, but I also got ~16% performance gain for 4k video with the new update.

https://media.discordapp.net/attachments/290709370600423424/1062122814833950810/image.png?width=509&height=545

487 (edited by grobalt 09-01-2023 21:44:09)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

i am not interested in transcoding -> uhd transcoding to h265 is about 35fps now , bottleneck is the 6core cpu running at 100% and gpu at 70%

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

What alola wrote the last days has just be to wrong .. impossible the results for his 3070ti with the old script.

DragonicPrime is something odd as well.
I can go MPV HDR on and OFF (Try to recover HDR colors) with frame doubling without dropped frames with a 5600x and RTX4090.

Now i need to figure out how to get that stuff integrated into a MadVR Player smile

The LG Demo File is lagging (about 2900 dropped frames at output for the full clip), 3 Rife Threads. No performance difference HDR on and off setting.

I don't have "try to recover HDR colors" on. What resolution is your display? Because on my 4k TV, i get frame drops with HDR and it doesn't work. On my second monitor which is just 1080p, MPV is downscaling it, so it runs perfectly

489 (edited by grobalt 09-01-2023 21:54:17)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

my PC monitor is just 2k, so i use DSR to check 4k resolution, otherwise mpv is downscaling smile Windows running in 3840x2160 on 2k display (uggly, but mandatory to check 4k performance with mpv)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

my PC monitor is just 2k, so i use DSR to check 4k resolution, otherwise mpv is downscaling smile Windows running in 3840x2160 on 2k display (uggly, but mandatory to check 4k performance with mpv)

Not sure why then. That's what's happening on my 4k TV. Regular 4K runs perfectly at 2x with no frame drops, but HDR causes stutters and low frame rate

491

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

DragonicPrime wrote:

On my second monitor which is just 1080p, MPV is downscaling it, so it runs perfectly

The question is whether MPV downscaling in real time to 1080p preserves the 10-bit colour depth and HDR when interpolating in real time with RIFE.

In other words, could you compare the colours of the video below played back without interpolation and with RIFE interpolation.

and what interpolation factor (x2, x3, x4) is possible with such a 1080p 10-bit HDR file:

LG 4K HDR Demo - New York.ts

compared to 1080p 8-bit?

492 (edited by Pezede 09-01-2023 22:07:03)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

I've done a reinstall of SVP and I'm now getting ~280fps on 1080P transcoding with the new guide, that seems almost miraculous...

I've gotten the console window and there are lock files in the rife folder so it seems to be used.

Hardware is 4090 paired with a 7950X and DDR5 6000 ram.

Post's attachments

explorer_i4zouMRe9a.png 24.52 kb, 49 downloads since 2023-01-09 

msedge_NmMV4yyOro.png, 32.06 kb, 610 x 399
msedge_NmMV4yyOro.png 32.06 kb, 117 downloads since 2023-01-09 

SVPManager_yC8DfPLyRI.png, 47.99 kb, 607 x 573
SVPManager_yC8DfPLyRI.png 47.99 kb, 122 downloads since 2023-01-09 

493

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

Pezede wrote:

I've done a reinstall of SVP and I'm now getting ~280fps on 1080P transcoding with the new guide, that seems almost miraculous...

I've gotten the console window and there are lock files in the rife folder so it seems to be used.

Hardware is 4090 paired with a 7950X and DDR5 6000 ram.

so CPU and RAM really matter!

494

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

DragonicPrime wrote:
UHD wrote:
DragonicPrime wrote:

Just tried the updated instructions. Getting around 50fps at 4k with an RTX 4090 now. Between 170-190fps(it kept going up and down for some reason) at 1080p. These improvements are huge. Thanks for updating the instructions

Could you check if the video below can now be interpolated in real time with RIFE?
Second question: is it possible to preserve the 10 bit colour depth and HDR when interpolating in real time with RIFE the video below?
In other words, could you compare the colours of the video below played back without interpolation and with RIFE interpolation.

LG 4K HDR Demo - New York.ts
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

4k HDR still doens't work in real time. I just updated my previous message as well. 4K SDR seems to work with no problems in real time though. 4K with HDR, I only get around 35-40fps


Pezede, would you please check the above demo in real time 4K HDR and fps, we would have an interesting comparison.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

I replicated the exactly same setting as shown by Pezede for transcoding -> frames by 5 for a 24p 1080p movie, lossless preset etc
Ryzen 5600x, 3800 MHz Memory -> starts with about 190fps

doing the same for a 4k uhd movie -> 32,8fps
same for the LG New York Demo clip, 32 fps

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

I deleted SVP and startet from scratch, just to check if the inscructions are complete and everything is working.
There is a step missing.
After replacing generate.js and base.py, start SVP4, add the new option TensorRT etc.

Then the missing step:
Copy the Rife AI profile and select the AI Model "rife"
Enable the new Option TensorRT On

Alrighty, this worked! Now it looks as smooth as with mpv-lazy, might be smoother looking at what you guys are saying, but cannot check since I am capped at 1080@60.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

so to do real-time 4k you need really good RAM bandwidth first, then GPU and CPU last, since my CPU usage is very low.

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
DragonicPrime wrote:

On my second monitor which is just 1080p, MPV is downscaling it, so it runs perfectly

The question is whether MPV downscaling in real time to 1080p preserves the 10-bit colour depth and HDR when interpolating in real time with RIFE.

In other words, could you compare the colours of the video below played back without interpolation and with RIFE interpolation.

and what interpolation factor (x2, x3, x4) is possible with such a 1080p 10-bit HDR file:

LG 4K HDR Demo - New York.ts

compared to 1080p 8-bit?

my display is 60hz at my pc, so output drops everything above 60fps.
multiplied by 4 is running smooth with 1920x1080 downscaling

Post's attachments

1080p.jpg, 429.02 kb, 929 x 797
1080p.jpg 429.02 kb, 118 downloads since 2023-01-09 

499

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

grobalt wrote:

I replicated the exactly same setting as shown by Pezede for transcoding -> frames by 5 for a 24p 1080p movie, lossless preset etc
Ryzen 5600x, 3800 MHz Memory -> starts with about 190fps

doing the same for a 4k uhd movie -> 32,8fps
same for the LG New York Demo clip, 32 fps

Is your 1080p also 1920x1080, because that matters too?

500 (edited by Pezede 09-01-2023 22:41:02)

Re: New RIFE filter - 3x faster AI interpolation possible in SVP!!!

UHD wrote:
DragonicPrime wrote:
UHD wrote:

Could you check if the video below can now be interpolated in real time with RIFE?
Second question: is it possible to preserve the 10 bit colour depth and HDR when interpolating in real time with RIFE the video below?
In other words, could you compare the colours of the video below played back without interpolation and with RIFE interpolation.

LG 4K HDR Demo - New York.ts
File size: 448 MiB
Duration: 1 min 13 sec
Overall bit rate: 51.4 Mbps
HDR format: SMPTE ST 2086, HDR10 compatible
Width: 3 840 pixels
Height: 2 160 pixels
Frame rate: 25.000 FPS
Color space: YUV
Chroma subsampling: 4:2:0
Bit depth: 10 bits

Direct link: https://drive.google.com/file/d/1dfR5TT … _bGfEXUvJ/
Source: http://hdr4k.blogspot.com/

4k HDR still doens't work in real time. I just updated my previous message as well. 4K SDR seems to work with no problems in real time though. 4K with HDR, I only get around 35-40fps


Pezede, would you please check the above demo in real time 4K HDR and fps, we would have an interesting comparison.

I just ran it on my LG C1:

movie *2 :

https://i.imgur.com/m6NLcak.jpeg

movie *3 :

https://i.imgur.com/cSYcCPx.jpeg


I start seeing dropped frames past 80fps, playback seems perfect up to that point.

80fps :

https://i.imgur.com/KlLKxWX.jpeg

Movie * 4 is unwatcheable.

I also tried with 4 threads, no difference.