I had similar issues with logo overlays causing motion defects when the video panned. My test file: https://vimeo.com/51322829 I run 'SVP' via avisynth so I don't have the SVP settings off the top of my head. But here is the pertinent part of the avisynth script I use. Basically I reduced the block size to 16 (H&V) and set overlap to 2. It didn't completely cure it but it's 'not all that bad' now.
BTW: These are settings for a 720P/23.976 video displayed at 59.938
nnedi3_rpow2(rfactor=2,cshift="Spline36Resize",fwidth=1920,fheight=1080,nsize=0,nns=2,qual=1)
global crop_params=""
global resize_string=""#spline36resize(2560,1440) lanczos4resize(1920,1080)
global super_params="{pel:2,scale:{up:0},gpu:1,full:true,rc:true}"#pel:1 full:false
global analyse_params="{block:{overlap:2,w:16},main:{search:{coarse:{distance:-10},distance:0}},refine:[{thsad:250}]}"#overlap:0,w:32
global smoothfps_params="{rate:{num:5,den:2},algo:13,mask:{cover:80},scene:{blend:true,limits:{scene:6000,zero:100,blocks:51}}}"
#global smoothfps_params="{rate:{num:24000,den:1001,abs:true},algo:23,mask:{cover:80},scene:{blend:true}}"