Уже давно бы купил рязань 1700 за 5к рублей big_smile

Chainik wrote:

> Well unless I decide to rewind  big_smile its 100% freeze as well

this is what I'm saying
every re-initialization will hangs
and for me the first-time initialization hangs too in 99% of times

did u try vulkan render ?

Chainik wrote:

dlr5668
I solved freezing. You will need to disable black bar detection

nope, this would be too easy...
it just hangs at random times. with black bars detection the chances are higher just because two script initializations instead of one.

every time I click https://i.imgur.com/FGJ2AbW.png it will 100% freeze. I watched 2h realtime and so far it never hungs. Well unless I decide to rewind big_smile its 100% freeze as well

I solved freezing. You will need to disable black bar detection

C:\Program Files (x86)\SVP 4\mpv64\mpv conf

input-ipc-server=mpvpipe

# hardware video decoder
hwdec=auto-copy
hwdec-codecs=all

vo=gpu

# high quality video output, require rather fast video card
profile=gpu-hq

# D3D11 renderer (default) is required for the HDR playback
#gpu-api=d3d11

# use VULKAN API if you have problems with the default d3d11 renderer
gpu-api=vulkan

# miscellaneous options

# comment this one if you want mpv to remember the playback position
save-position-on-quit=yes

# fixes audio desync
hr-seek-framedrop=no

# "ReClock" replacement
video-sync=display-resample
video-sync-max-video-change=25

C:\Program Files (x86)\SVP 4\script\base.py

def interpolate(clip):
# input_um - original frame in 4:2:0
# input_m  - cropped and resized (if needed) frame
# input_m8 - input_m converted to 8-bit
#RESIZE-CODE
    input_m = input_m.misc.SCDetect()
    input_m = input_m.resize.Bicubic(format=vs.RGBS, matrix_in_s="709")
    smooth = RIFE(input_m,model_ver=3.8,fp16=False,scale=1.0,device_index=rife_gpu)
    smooth = smooth.resize.Point(format=input_um.format.id, matrix_s="709")
    smooth = core.svp2.SmoothFps_RIFE(smooth,smoothfps_params,src=input_um,fps=src_fps*2)
    return smooth
#FORCE-CFR
smooth =  interpolate(clip)

switch profile when mpv in windowed mode. 70ti is enough to watch 720p with few drops (about 10 per 2 minutes). I ll need to increase buffer

UHD wrote:

Then we know that:

1. vs-rife can interpolate in real time, but at scale=0.5
2. vs-rife has a problem with realtime interpolation at scale=1, even when fps with reencoding and VRAM is sufficient.

https://www.playbook.com/vadash/NPbJXaD … ABj6bV6hwQ

requires a google account, which I do not have

https://www.playbook.com/s/vadash/wcVXb … ABj6bV6hwQ

UHD wrote:

Thank you very much for checking.

Some time ago you wrote:

dlr5668 wrote:

At least my mpv is not crashing big_smile rewind takes 3-4 sec though

Does this mean that with scale=0.5 you were able to successfully interpolate in real time playback?

yep https://www.playbook.com/vadash/NPbJXaD … ABj6bV6hwQ

UHD wrote:
dlr5668 wrote:

realtime broke for me after some experiments and now hungs up big_smile

3.5 and 3.8 models takes ~5 GB VRAM under pytorch


Thanks.

Could you try some smaller: 240p 360p or 480p file?

source https://www.youtube.com/watch?v=4Ps6nV4wiCE
model 3.5 scale 1.0
1280x720  50 fps 3.2 GB VRAM
854x480 92 fps 1.7GB VRAM

No luck with playing. Doesnt matter what res or windowed / fullscreen

realtime broke for me after some experiments and now hungs up big_smile

3.5 and 3.8 models takes ~5 GB VRAM under pytorch

vsrife 1.3 broke conversion

06:47:01.966: ===== Starting mpv ======
06:47:01.966: Command line: C:\Program Files (x86)\SVP 4\mpv64\mpv.exe E:/media/shows/[LowPower-Raws] Boku no Hero Academia S4 (BD 1080P x265 Ma10p FLAC)/[LowPower-Raws] Boku no Hero Academia S4 - 08 (BD 1080P x265 Ma10p FLAC).mkv --o=E:/media/shows/[LowPower-Raws] Boku no Hero Academia S4 (BD 1080P x265 Ma10p FLAC)/[LowPower-Raws] Boku no Hero Academia S4 - 08 (BD 1080P x265 Ma10p FLAC).SVP.temporary.mkv --no-audio --no-sub --no-sub-auto --input-ipc-server=mpvencodepipe --input-media-keys=no --no-msg-color --vf=vapoursynth:[C:\Users\vadash\AppData\Roaming\SVP4\scripts\ffff.py]:4:24 --of=matroska --ovc=h264_nvenc --ovcopts=b=35010130,preset=slow,profile=high,rc=vbr,maxrate=45513169,bufsize=70020260,time_base=1000/47952,threads=24
06:47:02.056: (+) Video --vid=1 (*) (hevc 1920x1080 23.976fps)
06:47:02.056: Audio --aid=1 --alang=jpn (*) (flac 2ch 48000Hz)
06:47:03.560: [vapoursynth] Script evaluation failed:
06:47:03.560: [vapoursynth] Python exception: Ran out of input
06:47:03.560: [vapoursynth]
06:47:03.560: [vapoursynth] Traceback (most recent call last):
06:47:03.560: [vapoursynth] File "src\cython\vapoursynth.pyx", line 2244, in vapoursynth.vpy_evaluateScript
06:47:03.560: [vapoursynth] File "src\cython\vapoursynth.pyx", line 2245, in vapoursynth.vpy_evaluateScript
06:47:03.560: [vapoursynth] File "C:\Users\vadash\AppData\Roaming\SVP4\scripts\ffff.py", line 70, in <module>
06:47:03.560: [vapoursynth] smooth = interpolate(clip)
06:47:03.560: [vapoursynth] File "C:\Users\vadash\AppData\Roaming\SVP4\scripts\ffff.py", line 51, in interpolate
06:47:03.560: [vapoursynth] smooth = RIFE(input_m,model_ver=3.8)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\vsrife\__init__.py", line 77, in RIFE
06:47:03.560: [vapoursynth] model.load_model(os.path.join(os.path.dirname(__file__), model_dir), -1)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\vsrife\model38\RIFE_HDv3.py", line 40, in load_model
06:47:03.560: [vapoursynth] self.flownet.load_state_dict(convert(torch.load('{}/flownet.pkl'.format(path))), False)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\torch\serialization.py", line 608, in load
06:47:03.560: [vapoursynth] return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\torch\serialization.py", line 777, in _legacy_load
06:47:03.560: [vapoursynth] magic_number = pickle_module.load(f, **pickle_load_args)
06:47:03.560: [vapoursynth] EOFError: Ran out of input
06:47:03.560: [vapoursynth]
06:47:03.652: (!!!) Intermediate file may be broken: E:\media\shows\[LowPower-Raws] Boku no Hero Academia S4 (BD 1080P x265 Ma10p FLAC)\[LowPower-Raws] Boku no Hero Academia S4 - 08 (BD 1080P x265 Ma10p FLAC).SVP.temporary.mkv
06:47:03.652: ===== mpv exited with code 62097 =====
UHD wrote:
Chainik wrote:

> What then does scale=2

the opposite? upscale before, downscale after

So, scale=1 will probably be the optimal solution. Somehow I don't believe that upscaling will bring any significant improvement. On the other hand, downscaling is not only cheating, but also a significant reduction in quality.

Yep lets wait for fp16 tweaks. Even x2 would allow us to watch in real time and author claims x4

Chainik wrote:

> Whats about fp16 ? Do we need to retrain models ?

no idea...

so, 1080p actually plays at 27 fps only, not 54.
54 is with scale=0.5

At least my mpv is not crashing big_smile rewind takes 3-4 sec though

Chainik wrote:

if I understand it correctly, scale=0.5 just downscales the whole frame before the "AI" magic, then upscales the result back --> you just get lower resolution intermediate frames
this is why it's "cheating"

Yep after reading rife script I understand. Whats about fp16 ? Do we need to retrain models ?

Chainik wrote:

just use this file - https://www.svp-team.com/forum/viewtopi … 183#p79183

"scale=0.5" is cheating big_smile

scale 1.0 drops to 28 and fp16 has no effect right now (even drops 1 fps)

Chainik wrote:

> How can I do that ?

switch via profiles menu in runtime

Nice

https://i.imgur.com/uoW1Sez.png

smooth = RIFE(input_m,model_ver=3.8,scale=0.5,device_index=rife_gpu,fp16=False)

54 fps

smooth = RIFE(input_m,model_ver=3.8,scale=0.5,device_index=rife_gpu,fp16=True)

44 fps

So using fp16 actually reduces fps ? wtf

UHD wrote:

I cannot believe it!

1920x1080 23.976 x2 and 54,0fps with RIFE!!!

So, NVIDIA GeForce RTX 3070 Ti is capable of producing enough frames per second in 1080p files today to think about x2 real-time interpolation!!!

Please post more, you are doing a great job!

Now, the most important question: do you have the same problem as Chainik on the Turing microarchitecture when attempting real-time interpolation?

Chainik wrote:

mpv just hangs after switching to RIFE profile in a real time
no idea why

Thank you very much!!!


How can I do that ? I tried

https://i.imgur.com/ss33OUG.png

but it uses old profile

Chainik wrote:

ok, so 3070 Ti is the absolute minimum for 1080p real-time playback

what is GPU temperature after 1 hour of encoding? smile

> I was changing this line and restarting svp, right ?

yep

I mine 24/7 on this PC when I am not using it so its 75c core / 96 mem junction with silent curve

I followed original chainik post. I ll be uploading videos to https://www.playbook.com/s/vadash/wcVXb … Ky5jaQMkLs so we can compare
My hardware https://valid.x86.fr/4z07b1
Source will be Stargate.Atlantis.S05E01.Multi.1080p.BluRay.DTS-HDMA.5.1.H.264-CELESTIS-055 30 sec fragment
Encoding H265 max q

my gpu (2010 @ 1V +500 mem)
https://i.imgur.com/gshg3JZ.png

half 3.8
https://i.imgur.com/UPZoB7W.png

full 3.8
https://i.imgur.com/l91DsBP.png

half 3.5
https://i.imgur.com/MRQIrUN.png

I was changing this line and restarting svp, right ?

smooth = RIFE(input_m,model_ver=3.5,scale=1.0 if rife_precision else 0.5,device_index=rife_gpu)

720p test
https://i.imgur.com/U62Cbp5.png

Hm, I thought we wont be able to watch HD real time before new RTX 6XXX series. I ll try with my 3070ti soon

why ? switch to mpv and use default dx render

171

(7 replies, posted in Using SVP)

jbiribi wrote:
Chainik wrote:

> what really is NVIDIA Optical Flow

NVIDIA's own GPU-only motion estimation algorithm producing motion vectors field for a given two images

> what benefits it would bring

move the most CPU-consuming part of me/mc algorithm to GPU

Example of the artefacts that I have only with optical flow on

https://youtu.be/TH2xDMS1asQ?t=11

Yep. High res and integer multiplier will reduce them

Только добрался до ПК. Как то она у тебя летает по экрану. Вот моя 23.976 * 3 + 4% = 75 гц моник

https://youtu.be/X447KdUpt9Y

173

(10 replies, posted in Using SVP)

for 4k 10bit high FPS you need either RTX or fast ram. I had problems until I OC my RAM to 3800. I have 5900x

www.lr.kr wrote:

Уточнение, в madvr должно стоять "present several frames in advance".

А можешь врубить дебаг полоску в свп и снять на телефон насколько это плавно ?

Хоть убей не могу повторить у себя

Just updated other way around 480 to 3070 ti. No problems with both. Maybe try mpv ?