Search options (Page 9 of 12)

Thank you very much for the testing I requested and thank you very much for your willingness to continue to help on this thread.

I have read your post and the test results very carefully. I will come back to certain aspects of these results, but for now I am bothered by a few points:

1.

Did you make this change only before the tests I asked you to do, or before when you wrote in the previous post:

If I understand, by setting "GPU threads: 6" early on you were actually setting scale=0.5, according to this post: https://www.svp-team.com/forum/viewtopi … 183#p79183
which obviously doesn't do the quality any good: https://www.svp-team.com/forum/viewtopi … 250#p79250

2.

Can you share a fragment of the above code that you modified in base.py ?

3.

Request for a short test: to see if changing the GPU threads parameter changes anything in performance after the change in base.py you made.

Test A:

Test-Time Augmentation: Enabled [sets RIFE filter for VapourSynth (PyTorch)]
AI model: Generic [with above PyTorch version it doesn't matter, because it is set in the 2nd version of base.py by Chainik permanently to model 3.8]
Math precision: Half (FP16)
GPU threads: 2
Test file:
original demo video from the creator of RIFE at: https://github.com/hzwer/arXiv2020-RIFE
720p (1280x720), 25FPS, 53 s 680 ms, 4:2:0 YUV, 8 bits
direct link: https://drive.google.com/file/d/1i3xlKb … sp=sharing

Test B:

Same, except for one parameter:
GPU threads: 6

Please present the performance results as Chainik did in this post: https://www.svp-team.com/forum/viewtopi … 465#p78465

I think such a scheme with 3 parameters will be the best to present these and future results:

Test A
GPU: XX% (XX% Compute_1)
VRAM: X.X GB
SVP index: X.X

Of course, this could be "Compute_1" "Compute_0", "Cuda" or another virtual node, loaded by RIFE.This most accurately shows the actual utilization of GPU computing power by RIFE.

I don't use Linux myself, nor am I familiar with it, but I agree with your request. The more testers the better.

I am also glad that another person took an interest in this topic and added something from himself, which I think will help many other people including me.

I have a request to you: could you please stay with us for a while on this thread and help us test real-time playback with RIFE?

I have read your post thoroughly and will be returning to individual parts in the near future. However, I don't want to write about everything at once as it will be a bit overwhelming, so I will do it gradually.

Firstly, a big thank you for finding a solution to the script problem. I hope this helps egandt and encourages others to test.

Right now I think the most important thing is to get as many people interested in the topic as possible to replicate your path to success with RIFE

My first question:

Could you please elaborate on what these problems were and how you dealt with them? That might help a lot of people.

Now I will have a request for you to do some simple tests to help us determine the causes of the image freezing that have been described on this thread.

Test parameters:

SVP+VLC media player+RIFE filter for VapourSynth (PyTorch)
real time playback with x2 interpolation:
RIFE model: 3.8
scale=1.0
FP32 or FP16 (your preferred choice)
GPU threads: (your preferred choice)
Test file:
original demo video from the creator of RIFE at: https://github.com/hzwer/arXiv2020-RIFE
720p (1280x720), 25FPS, 53 s 680 ms, 4:2:0 YUV, 8 bits
direct link: https://drive.google.com/file/d/1i3xlKb … sp=sharing
Monitor set to 50Hz or 100Hz or 150Hz or 200Hz

Test file only if image freezes more than 30s on 720p file:
240p (320x240), 15FPS, 6 min 8 sec, 4:2:0 YUV, 8 bits
https://sample-videos.com/video123/mp4/ … p_30mb.mp4

Test variables based on dlr5668 postings
https://www.svp-team.com/forum/viewtopi … 315#p79315
https://www.svp-team.com/forum/viewtopi … 321#p79321

1. disable black bar detection
2. enable black bar detection
3. switch profile in windowed mode
4. switch profile in full screen mode
5. gpu-api=vulkan
6. gpu-api=d3d11

Testing: does the image freeze and for how long (30s = permanent) during:

A. real-time playback with RIFE - first-time initialization
B. real-time playback with RIFE - after pause
C. real-time playback with RIFE - after rewind
B. real-time playback with RIFE - after fast forward

I would be very grateful if you could find some time to run these tests.

Great! With this graphics card theoretically it should be possible to interpolate 720p video in real time using SVP with RIFE filter for VapourSynth (PyTorch version) without any problem!

If we can find a solution for script failure using PyTorch based RIFE, this smaller 240p 15FPS file can be used to test x4 real-time interpolation with RIFE!

That being said, I hope you don't give up and keep actively contributing to this thread until a solution can be found. Since dlr5668 was successful: https://www.svp-team.com/forum/viewtopi … 315#p79315 there must be some way to make it work on the 3080 TI too!

I'm still looking for someone with an NVIDIA GPU and some time to test real-time interpolation using SVP with RIFE filter for VapourSynth (PyTorch version):

https://www.svp-team.com/forum/viewtopi … 023#p79023

I'm still looking, as so far only dlr5668 has confirmed that he has successfully done this, but unfortunately it freezes during rewind:
https://www.svp-team.com/forum/viewtopi … 319#p79319

However, I have not been able to find out if this is a permanent or temporary situation. Also, I was unable to find out if it freezes on pause and when resuming playback. The latter is particularly important to me, because if I want to watch something with the best real-time interpolation on PC that RIFE provides, without the possibility of pausing and resuming playback this solution would be doomed to failure for me.

If anyone is wondering why I don't check it myself, the matter is trivially simple: I don't have a modern NVIDIA GPU, because I didn't need it for anything. It is the RIFE interpolation algorithm based on machine learning (artificial intelligence) that could make me purchase such a card and a large expenditure would be justified.

This is why I keep bumping this thread - to find out if smooth real-time interpolation along with pause and resuming playback is possible using SVP with RIFE filter for VapourSynth (PyTorch version).

Thank you very much XKCorp for testing and sharing your results

Could you please further clarify the parameters with which you performed the test with 512x384 resolution?
I am interested in the following data:

1. Which filter did you use?

https://www.svp-team.com/forum/viewtopi … 023#p79023

2. Which scale? 1.0 or 0.5?

3. Which RIFE model? 3.8 or other?

4. Did you try FP32 with 512x384 resolution? Or only FP16 was able to interpolate in real time with SVP index 1.0?

5. Did it freeze on pause and when resuming playback? If yes: temporary (how long) or permanent (over 1 minute)?

6. Did it freeze on rewind? If yes: temporary (how long) or permanent (over 1 minute)?

7. Did you freeze on fast forward? If yes: temporary (how long) or permanent (over 1 minute)?

Did it help?

You read my mind and answered a question that has not yet been asked

Does it also freeze on pause and when resuming playback?
What about fast forward?

Have you checked the VRAM and GPU consumption when freezing, not general but in detail:
compute_0
compute_1
CUDA
?

Is the freezing temporary or permanent (over 1 minute)?

Does it freeze the same way on light files like 180p (scale=1.0)?

Thank you so much. You are a genius!
I see you sat on the problem a little longer and found a solution!

Thanks also for uploading the detailed configuration files. This will be very useful for me and others who would like to use RIFE for real-time interpolation.

Thanks to Chainik for implementing RIFE AI interpolation in SVP!
Thanks to dlr5668 for testing and finding a working configuration for real-time HD file interpolation!

del

Thank you very much for checking.

Some time ago you wrote:

Does this mean that with scale=0.5 you were able to successfully interpolate in real time playback?