Search options (Page 10 of 12)

Thanks for asking what I want. I think the answer to that question will lighten the context of my posts a bit.

I want to:

1. Take advantage of the fact that hzwer is actively developing RIFE AI interpolation and actively communicating with the community: https://github.com/hzwer/arXiv2020-RIFE

2. Take advantage of the fact that HolyWu is actively developing the RIFE filter for VapourSynth based on PyTorch and is actively communicating with the community: https://github.com/HolyWu/vs-rife

Of course, I would very much like to see the RIFE filter for VapourSynth based on ncnn developed as well: https://github.com/HomeOfVapourSynthEvo … cnn-Vulkan Here the problem arises that HolyWu is dependent on the nihui project for this filter: https://github.com/nihui/rife-ncnn-vulkan

And this is where the problem lies... nihui has not been developing this project for 4 months and does not respond to users problems: https://github.com/nihui/rife-ncnn-vulkan/issues Of course we should be grateful that he has made the code available for us all to use. We must remember that he makes his work available for free and that any support depends on his good will and the time he has available.

However, this does not change the fact that we do not know if there will ever be any update to the code created by nihui. The situation is similar with NVIDIA's GPU implementation of CUDA inference support for the well-known Tencent NCNN inference engine: https://github.com/atanmarko/ncnn-with-cuda further development of which is essential to be able to efficiently interpolate in real time using Vulkan.

If nothing changes, the long-awaited RIFE interpolation model 4 prepared by hzwer will only be usable in SVP thanks to HolyWu and the actively developed the RIFE filter for VapourSynth based on PyTorch: https://github.com/HolyWu/vs-rife

This is exactly what I want: I ask everyone including you Chainik to test the RIFE filter for VapourSynth based on PyTorch with SVP for real-time interpolation and take advantage of the fact that all possible problems and suggestions for improvements can be reported to HolyWu and hzwer and there is a good chance that they will be addressed for the benefit of all of us who want to have frame interpolation without artifacts.

Could you please elaborate a bit on this topic?
Did you manage to interpolate a video in real time according to these descriptions:
https://www.svp-team.com/forum/viewtopi … 023#p79023
https://www.svp-team.com/forum/viewtopi … 183#p79183 

Which scale in RIFE? What graphics card? What file resolution? Did it not crash?

I can't help you with g-sync, but if you manage to use it, you will get the best possible sync and you can use x3 or x5 interpolation in SVP.

If you fail with g-sync, then if you want to reduce stuttering on panning images to a minimum, then as I wrote x5 in SVP and 119.88 Hz in TV.

So, scale=1 will probably be the optimal solution. Somehow I don't believe that upscaling will bring any significant improvement. On the other hand, downscaling is not only cheating, but also a significant reduction in quality.

I cannot believe it!

1920x1080 23.976 x2 and 54,0fps with RIFE!!!

So, NVIDIA GeForce RTX 3070 Ti is capable of producing enough frames per second in 1080p files today to think about x2 real-time interpolation!!!

Please post more, you are doing a great job!

Now, the most important question: do you have the same problem as Chainik on the Turing microarchitecture when attempting real-time interpolation?

Thank you very much!!!

Теперь в SVP есть еще более быстрая версия RIFE. Даже в 3 раза быстрее. Не стесняйтесь протестировать ее и поделиться своими результатами:
https://www.svp-team.com/forum/viewtopic.php?id=6281

RIFE filter for VapourSynth (PyTorch) is already completely capable of producing enough frames per second in HD files today to think about real-time interpolation. Below are examples of using RIFE in FlowFrames:

RTX 3080 - 1280x720p - 55.5 FPS
RTX 3090 - 1280x720p - 60 FPS

More examples here:
https://github.com/n00mkrad/flowframes/ … chmarks.md

It should be mentioned that these are examples from 8 months ago, and the latest 3.8 algorithm is much faster, as I wrote above.

Are there any people reading this thread who have already tried the RIFE filter for VapourSynth (PyTorch) implemented in SVP?

Thank you very much for the upgrade and sharing the test results.

Strange...
cheesywheesy claims x4 on 3090.
n00mkrad, creator of Flowframes, claims that fp16 does not work with newer models:
https://github.com/hzwer/arXiv2020-RIFE/issues/188

Maybe it's a matter of the interpolation model used, or the GPU? I unfortunately can't check this as I don't have a compatible graphics card yet. Maybe someone else could check the speed in SVP and in Flowframes?

Does this mean that you are using a default model in the Pytorch version? If so, this is version 3.5:
https://github.com/HolyWu/vs-rife/blob/ … t__.py#L10

If so, it is neither the latest model nor, unfortunately, the fastest.
3.8 model is the fastest!

https://github.com/hzwer/arXiv2020-RIFE/issues/176

https://grisk.itch.io/rife-app/devlog/2 … 207-update

Chainik, could you take a second look at running this filter in SVP in real time.

Could you please try to use VLC or any other DirectShow player?
Could you please try to use other some very, very low resolution file?
Could you please try to wait a few more minutes?
Have you checked, maybe hardware is the bottleneck? VRAM? RAM?

I'd love to help, but I'm neither a programmer nor have a proper graphics card currently.

HolyWu is actively supporting the RIFE filter for VapourSynth based on PyTorch, maybe he will be able to help you over the implementation of this filter for real-time interpolation?

Chainik, you will know best what to ask. I can of course write a request myself, but apart from the fact that it doesn't work I won't be able to add anything else, because I simply don't know anything about it :-(

Chainik, did you manage to solve the problem of mpv hanging after switching to RIFE profile in a real time?

What about other players?

https://www.svp-team.com/wiki/RIFE_AI_interpolation

Have you tried using VLC or any other DirectShow player?
Have you tried using other some very, very low resolution file?
Have you tried waiting a few more minutes?
Have you checked, maybe hardware is the bottleneck? VRAM? RAM?

I'd love to help, but I'm neither a programmer nor have a proper graphics card currently.

That's not good...

https://github.com/hzwer/arXiv2020-RIFE/issues/188

And was it possible to solve the problem of mpv hanging after switching to RIFE profile in a real time?

I hope that a solution can be found. It is the real-time interpolation that I care most about. Of course it could be tomorrow, the day after tomorrow next week, whenever you have some time to find the cause.

Thank you once again!

And now I will present below the main advantages of the new RIFE filter for VapourSynth over its predecessor:

1. The RIFE filter for VapourSynth based on PyTorch: https://github.com/HolyWu/vs-rife is at least 3 times faster in performance than the RIFE filter for VapourSynth based on ncnn: https://github.com/HomeOfVapourSynthEvo … cnn-Vulkan

Developer confirmation of the above filters:
https://github.com/HomeOfVapourSynthEvo … n/issues/5

SVP developer confirmation:
https://github.com/nihui/rife-ncnn-vulkan/issues/22

Confirmation by one more person:
https://github.com/nihui/rife-ncnn-vulkan/issues/26

This is obviously a major advantage, especially if we think about real-time RIFE AI interpolation. This new PyTorch-based filter is especially useful for SVP users, as SVP is the only program on the market that allows real-time motion interpolation using AI with a GUI, that is friendly and easy to use for any user.

If someone wants to transcode video using RIFE AI motion interpolation then of course they have a wider choice of tools, because in addition to SVP they can choose from Flowframes, DVDFab or Rife-App among others.  When transcoding, the speed does not matter so much, because whether the procedure takes 3 hours or 9 hours, you still have to wait patiently.

However, when we want to perform interpolation in real time the situation looks completely different. Here, either the interpolation works in time or it does not. Either it is possible to watch or it is not.

The situation is worse than when playing computer games, where for example we either have 120fps or 40fps. In the latter case it is still possible to play, although with much less comfort. However, gamers can spend a lot of money, time and overclocking to gain at least those extra 10% fps!

And we have the chance to increase the performance by 3 times!!!