You are not logged in. Please login or register.
SmoothVideo Project → Posts by dlr5668
> Well unless I decide to rewind its 100% freeze as well
this is what I'm saying
every re-initialization will hangs
and for me the first-time initialization hangs too in 99% of times
did u try vulkan render ?
dlr5668
I solved freezing. You will need to disable black bar detectionnope, this would be too easy...
it just hangs at random times. with black bars detection the chances are higher just because two script initializations instead of one.
every time I click it will 100% freeze. I watched 2h realtime and so far it never hungs. Well unless I decide to rewind its 100% freeze as well
I solved freezing. You will need to disable black bar detection
C:\Program Files (x86)\SVP 4\mpv64\mpv conf
input-ipc-server=mpvpipe
# hardware video decoder
hwdec=auto-copy
hwdec-codecs=all
vo=gpu
# high quality video output, require rather fast video card
profile=gpu-hq
# D3D11 renderer (default) is required for the HDR playback
#gpu-api=d3d11
# use VULKAN API if you have problems with the default d3d11 renderer
gpu-api=vulkan
# miscellaneous options
# comment this one if you want mpv to remember the playback position
save-position-on-quit=yes
# fixes audio desync
hr-seek-framedrop=no
# "ReClock" replacement
video-sync=display-resample
video-sync-max-video-change=25
C:\Program Files (x86)\SVP 4\script\base.py
def interpolate(clip):
# input_um - original frame in 4:2:0
# input_m - cropped and resized (if needed) frame
# input_m8 - input_m converted to 8-bit
#RESIZE-CODE
input_m = input_m.misc.SCDetect()
input_m = input_m.resize.Bicubic(format=vs.RGBS, matrix_in_s="709")
smooth = RIFE(input_m,model_ver=3.8,fp16=False,scale=1.0,device_index=rife_gpu)
smooth = smooth.resize.Point(format=input_um.format.id, matrix_s="709")
smooth = core.svp2.SmoothFps_RIFE(smooth,smoothfps_params,src=input_um,fps=src_fps*2)
return smooth
#FORCE-CFR
smooth = interpolate(clip)
switch profile when mpv in windowed mode. 70ti is enough to watch 720p with few drops (about 10 per 2 minutes). I ll need to increase buffer
Then we know that:
1. vs-rife can interpolate in real time, but at scale=0.5
2. vs-rife has a problem with realtime interpolation at scale=1, even when fps with reencoding and VRAM is sufficient.https://www.playbook.com/vadash/NPbJXaD … ABj6bV6hwQ
requires a google account, which I do not have
Thank you very much for checking.
Some time ago you wrote:
dlr5668 wrote:At least my mpv is not crashing rewind takes 3-4 sec though
Does this mean that with scale=0.5 you were able to successfully interpolate in real time playback?
dlr5668 wrote:realtime broke for me after some experiments and now hungs up
3.5 and 3.8 models takes ~5 GB VRAM under pytorch
Thanks.
Could you try some smaller: 240p 360p or 480p file?
source https://www.youtube.com/watch?v=4Ps6nV4wiCE
model 3.5 scale 1.0
1280x720 50 fps 3.2 GB VRAM
854x480 92 fps 1.7GB VRAM
No luck with playing. Doesnt matter what res or windowed / fullscreen
realtime broke for me after some experiments and now hungs up
3.5 and 3.8 models takes ~5 GB VRAM under pytorch
vsrife 1.3 broke conversion
06:47:01.966: ===== Starting mpv ======
06:47:01.966: Command line: C:\Program Files (x86)\SVP 4\mpv64\mpv.exe E:/media/shows/[LowPower-Raws] Boku no Hero Academia S4 (BD 1080P x265 Ma10p FLAC)/[LowPower-Raws] Boku no Hero Academia S4 - 08 (BD 1080P x265 Ma10p FLAC).mkv --o=E:/media/shows/[LowPower-Raws] Boku no Hero Academia S4 (BD 1080P x265 Ma10p FLAC)/[LowPower-Raws] Boku no Hero Academia S4 - 08 (BD 1080P x265 Ma10p FLAC).SVP.temporary.mkv --no-audio --no-sub --no-sub-auto --input-ipc-server=mpvencodepipe --input-media-keys=no --no-msg-color --vf=vapoursynth:[C:\Users\vadash\AppData\Roaming\SVP4\scripts\ffff.py]:4:24 --of=matroska --ovc=h264_nvenc --ovcopts=b=35010130,preset=slow,profile=high,rc=vbr,maxrate=45513169,bufsize=70020260,time_base=1000/47952,threads=24
06:47:02.056: (+) Video --vid=1 (*) (hevc 1920x1080 23.976fps)
06:47:02.056: Audio --aid=1 --alang=jpn (*) (flac 2ch 48000Hz)
06:47:03.560: [vapoursynth] Script evaluation failed:
06:47:03.560: [vapoursynth] Python exception: Ran out of input
06:47:03.560: [vapoursynth]
06:47:03.560: [vapoursynth] Traceback (most recent call last):
06:47:03.560: [vapoursynth] File "src\cython\vapoursynth.pyx", line 2244, in vapoursynth.vpy_evaluateScript
06:47:03.560: [vapoursynth] File "src\cython\vapoursynth.pyx", line 2245, in vapoursynth.vpy_evaluateScript
06:47:03.560: [vapoursynth] File "C:\Users\vadash\AppData\Roaming\SVP4\scripts\ffff.py", line 70, in <module>
06:47:03.560: [vapoursynth] smooth = interpolate(clip)
06:47:03.560: [vapoursynth] File "C:\Users\vadash\AppData\Roaming\SVP4\scripts\ffff.py", line 51, in interpolate
06:47:03.560: [vapoursynth] smooth = RIFE(input_m,model_ver=3.8)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\vsrife\__init__.py", line 77, in RIFE
06:47:03.560: [vapoursynth] model.load_model(os.path.join(os.path.dirname(__file__), model_dir), -1)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\vsrife\model38\RIFE_HDv3.py", line 40, in load_model
06:47:03.560: [vapoursynth] self.flownet.load_state_dict(convert(torch.load('{}/flownet.pkl'.format(path))), False)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\torch\serialization.py", line 608, in load
06:47:03.560: [vapoursynth] return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
06:47:03.560: [vapoursynth] File "C:\Program Files (x86)\SVP 4\mpv64\lib\site-packages\torch\serialization.py", line 777, in _legacy_load
06:47:03.560: [vapoursynth] magic_number = pickle_module.load(f, **pickle_load_args)
06:47:03.560: [vapoursynth] EOFError: Ran out of input
06:47:03.560: [vapoursynth]
06:47:03.652: (!!!) Intermediate file may be broken: E:\media\shows\[LowPower-Raws] Boku no Hero Academia S4 (BD 1080P x265 Ma10p FLAC)\[LowPower-Raws] Boku no Hero Academia S4 - 08 (BD 1080P x265 Ma10p FLAC).SVP.temporary.mkv
06:47:03.652: ===== mpv exited with code 62097 =====
Chainik wrote:> What then does scale=2
the opposite? upscale before, downscale after
So, scale=1 will probably be the optimal solution. Somehow I don't believe that upscaling will bring any significant improvement. On the other hand, downscaling is not only cheating, but also a significant reduction in quality.
Yep lets wait for fp16 tweaks. Even x2 would allow us to watch in real time and author claims x4
> Whats about fp16 ? Do we need to retrain models ?
no idea...
so, 1080p actually plays at 27 fps only, not 54.
54 is with scale=0.5
At least my mpv is not crashing rewind takes 3-4 sec though
if I understand it correctly, scale=0.5 just downscales the whole frame before the "AI" magic, then upscales the result back --> you just get lower resolution intermediate frames
this is why it's "cheating"
Yep after reading rife script I understand. Whats about fp16 ? Do we need to retrain models ?
just use this file - https://www.svp-team.com/forum/viewtopi … 183#p79183
"scale=0.5" is cheating
scale 1.0 drops to 28 and fp16 has no effect right now (even drops 1 fps)
> How can I do that ?
switch via profiles menu in runtime
Nice
smooth = RIFE(input_m,model_ver=3.8,scale=0.5,device_index=rife_gpu,fp16=False)
54 fps
smooth = RIFE(input_m,model_ver=3.8,scale=0.5,device_index=rife_gpu,fp16=True)
44 fps
So using fp16 actually reduces fps ? wtf
I cannot believe it!
1920x1080 23.976 x2 and 54,0fps with RIFE!!!
So, NVIDIA GeForce RTX 3070 Ti is capable of producing enough frames per second in 1080p files today to think about x2 real-time interpolation!!!
Please post more, you are doing a great job!
Now, the most important question: do you have the same problem as Chainik on the Turing microarchitecture when attempting real-time interpolation?
Chainik wrote:mpv just hangs after switching to RIFE profile in a real time
no idea whyThank you very much!!!
How can I do that ? I tried
but it uses old profile
ok, so 3070 Ti is the absolute minimum for 1080p real-time playback
what is GPU temperature after 1 hour of encoding?
> I was changing this line and restarting svp, right ?
yep
I mine 24/7 on this PC when I am not using it so its 75c core / 96 mem junction with silent curve
I followed original chainik post. I ll be uploading videos to https://www.playbook.com/s/vadash/wcVXb … Ky5jaQMkLs so we can compare
My hardware https://valid.x86.fr/4z07b1
Source will be Stargate.Atlantis.S05E01.Multi.1080p.BluRay.DTS-HDMA.5.1.H.264-CELESTIS-055 30 sec fragment
Encoding H265 max q
my gpu (2010 @ 1V +500 mem)
half 3.8
full 3.8
half 3.5
I was changing this line and restarting svp, right ?
smooth = RIFE(input_m,model_ver=3.5,scale=1.0 if rife_precision else 0.5,device_index=rife_gpu)
720p test
Hm, I thought we wont be able to watch HD real time before new RTX 6XXX series. I ll try with my 3070ti soon
why ? switch to mpv and use default dx render
Chainik wrote:> what really is NVIDIA Optical Flow
NVIDIA's own GPU-only motion estimation algorithm producing motion vectors field for a given two images
> what benefits it would bring
move the most CPU-consuming part of me/mc algorithm to GPU
Example of the artefacts that I have only with optical flow on
Yep. High res and integer multiplier will reduce them
Только добрался до ПК. Как то она у тебя летает по экрану. Вот моя 23.976 * 3 + 4% = 75 гц моник
for 4k 10bit high FPS you need either RTX or fast ram. I had problems until I OC my RAM to 3800. I have 5900x
Уточнение, в madvr должно стоять "present several frames in advance".
А можешь врубить дебаг полоску в свп и снять на телефон насколько это плавно ?
Хоть убей не могу повторить у себя
Just updated other way around 480 to 3070 ti. No problems with both. Maybe try mpv ?
SmoothVideo Project → Posts by dlr5668
Powered by PunBB, supported by Informer Technologies, Inc.