1 Topic by Joachim Otahal (edited by Joachim Otahal 30-12-2018 20:31:17)

  • Thanks: 1

Topic: SVP Transcode: Script exceeded memory limit. Consider raising cache si

I am trying to transcode high resolution videos from 60 fps to 120 fps.
By "High Resolution" I mean: 12800x7200 60 fps as source.

This is "coder.log":
20:41:31.164: ===== Starting mpv ======
20:41:31.164: Command line: C:\Program Files (x86)\SVP 4\mpv64\mpv.exe D:/tmp/Bandicam/Asteroids 12800x7200.avi -o C:\tmp\out/Asteroids 12800x7200..SVP.temporary.mkv --no-audio --no-sub --no-sub-auto --input-ipc-server=mpvencodepipe --input-media-keys=no --vf=vapoursynth:[C:\Users\Jou\AppData\Roaming\SVP4\scripts\ffff.py]:4:16 --of=matroska --ovc=libx264 --ovcopts=preset=slower,crf=21,level=5.2,threads=16
20:41:31.211: Playing: D:/tmp/Bandicam/Asteroids 12800x7200.avi
20:41:31.505: (+) Video --vid=1 (h264 12800x7200 60.000fps)
20:41:35.252: Script exceeded memory limit. Consider raising cache size.
20:41:39.959: VO: [lavc] 12800x7200 yuv420p
20:41:39.959: [vo/lavc] Opening encoder: libx264 H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10 [libx264]
20:41:39.964: [ffmpeg] libx264: frame MB size (800x450) > level limit (36864)
20:41:39.964: [ffmpeg] libx264: DPB size (4 frames, 1440000 mbs) > level limit (0 frames, 184320 mbs)
20:41:39.964: [ffmpeg] libx264: MB rate (8640000000) > level limit (2073600)
20:41:40.016: [encode] Opening output file: C:\tmp\out/Asteroids 12800x7200..SVP.temporary.mkv
20:41:40.018: [encode] Opening muxer: Matroska [matroska]
20:41:40.150: V: -00:00:00 / 00:02:49 (0%) {21.9min 6.3MB}
20:42:40.365: V: 00:00:01 / 00:02:49 (0%) {139.9min 1.1fps 0.1MB}
20:43:08.629: out of memory: 460672000
20:43:21.540: (!!!) Intermediate file may be broken: C:\tmp\out\Asteroids 12800x7200..SVP.temporary.mkv
20:43:21.540: ===== mpv exited with code -1073740791 =====

A hint from https://forum.doom9.org/showthread.php? … p;page=155 says:
Try core.max_cache_size = 32768
When looking at coder.log I guess core.max_cache_size = 2048 or core.max_cache_size = 4096 might already be enough.
How do I integrate that into SVP trancoding?

To my surprise the 8k version of that video seems to work.

I made a short version (130 MB) of the 12k source video available on this (not yet public) page, see the first link:
http://joumxyzptlk.de/nvidia_asteroids.html

Any good hint would be nice.

Re: SVP Transcode: Script exceeded memory limit. Consider raising cache si

edit SVP 4/script/base.py, insert "core.max_cache_size = 32768" at the beginning

  • Thanks: 1

Re: SVP Transcode: Script exceeded memory limit. Consider raising cache si

Thanks!
core.max_cache_size = 2048
is enough.

  • Thanks: 1

Re: SVP Transcode: Script exceeded memory limit. Consider raising cache si

Nope, I have to correct myself. It still failes.

  • Thanks: 1

Re: SVP Transcode: Script exceeded memory limit. Consider raising cache si

BTW: I am suspecting an input problem here, when encoding to xvid I end up with an distorted 4608x7200 video instead of 12800x7200. And 12800 - 8192 is 4608. Would fit...

6 Reply by Joachim Otahal (edited by Joachim Otahal 30-12-2018 23:28:16)

  • Thanks: 1

Re: SVP Transcode: Script exceeded memory limit. Consider raising cache si

Sorry I wasted your time: It is simply "out of ram" error.
Using a manual .avs script with virtualdub gives me the 120 fps interpolation, but it eats over 16 GB just to display the video. Which does not leave enough RAM to do the encoding. x264 alone takes ~48 GB when encoding 12800x7200. And I have "only" 64 GB.