• UHD
  • Member
  • Offline
  • Thanks: 39
  • Thanks for the post: 1

Topic: IFRNet ncnn Vulkan - Release 20220720: faster and better than RIFE?

Great news!

nihui, who has made a very important optimisation of the AI RIFE algorithm for Tensor Cores and thanks to which we can already use this algorithm to interpolate 1080p files in real time....

an hour ago he published the full packages of the new AI interpolation algorithm optimised for Tensor Cores - IFRNet ncnn Vulkan
https://github.com/nihui/ifrnet-ncnn-vu … g/20220720

IFRNet algorithm source code:
https://github.com/ltkong218/IFRNet

Full description of the algorithm:
https://arxiv.org/pdf/2205.14620.pdf

2 Reply by UHD (edited by UHD 20-07-2022 18:02:55)

  • UHD
  • Member
  • Offline
  • Thanks: 39

Re: IFRNet ncnn Vulkan - Release 20220720: faster and better than RIFE?

An hour ago nihui wrote:

This is yet another new video frame interpolation AI like RIFE
It claims to be better and faster than RIFE in the paper

I ported IFRNet to ncnn-vulkan big_smile

https://twitter.com/nihui/status/1549763955396333568


For me, mainly interested in real-time interpolation, the IFRNet small interpolation model is particularly interesting:

RIFE 35.62 PSNR Vimeo90K vs. IFRNet small 35.59 PSNR Vimeo90K

Time:

RIFE 0.026 s  vs. IFRNet small 0.019 s

Source: https://arxiv.org/pdf/2205.14620.pdf


Practically similar quality with a 27% reduction in interpolation time.

Re: IFRNet ncnn Vulkan - Release 20220720: faster and better than RIFE?

UHD wrote:

Great news!

nihui, who has made a very important optimisation of the AI RIFE algorithm for Tensor Cores and thanks to which we can already use this algorithm to interpolate 1080p files in real time....

an hour ago he published the full packages of the new AI interpolation algorithm optimised for Tensor Cores - IFRNet ncnn Vulkan
https://github.com/nihui/ifrnet-ncnn-vu … g/20220720

IFRNet algorithm source code:
https://github.com/ltkong218/IFRNet

Full description of the algorithm:
https://arxiv.org/pdf/2205.14620.pdf

So the obvious question is how do we use this? Can we use it with SVP or do we have to wait to see if the DEVs can (or want to) incorporate it?

  • MAG79
  • SVP developer
  • Offline

Re: IFRNet ncnn Vulkan - Release 20220720: faster and better than RIFE?

It is one year old project with no updates at github.
I think RIFE become more fast and give more quality now because of it growing all last year.

Do you have any information about IFRNet updates?

Re: IFRNet ncnn Vulkan - Release 20220720: faster and better than RIFE?

MAG79 wrote:

It is one year old project with no updates at github.

Yes I noticed that, but I thought, or maybe hoped that there was something I was missing.