Constant crashes with SVP

I use SVP4 on Windows 10 with mpv.
I am using the latest mpv, latest vapoursynth, latest SVP4 Pro.

Lately, I have started getting constant crashes when playing files this way, event viewer gives "Display driver amdkmdap stopped responding and has successfully recovered." as a message.
The monitors shut down, the sound of the video file is running in the background and when my displays return, I can still hear the sound, mpv is shown in the taskbar (but I cannot see the video or the video frame itself anymore) and I have to close mpv through task manager.

My specs:
R7 1700 @3.8Ghz
RX480 @ 1350 Mhz
16GB RAM @ 2993 Mhz

What could be the reason for this? Is it because I use Vulkan? Or because I have the "watch later" on? I don't see how that'd interfere with the display driver.

My vulkan-related config entries:

profile=gpu-hq
gpu-api=vulkan
gpu-context=winvk
hwdec=no
hwdec-codecs=all
vd-lavc-dr=yes
vd-lavc-threads=16
vulkan-queue-count=8
vulkan-async-compute=yes