Search options

That video is very cool, I think it is actually running in the Skyrim game!

On an "IMAX size" flat screen you will only have very limited movement, because you don't want to zoom in too much, but even a small amount of movement is very important, normally when you watch a movie on a HMD (with no tracking) you must keep your head very still, if you move your head then the screen will move with your eyes and it makes you feel sick. This is because your balance sense tells your brain you are moving but your eyes have no motion reference, its a common problem and another good reason we need to get pan & scan working.

SVP colour bars give you a good reason to move your head, to see why they happened!  But when you hit the side of the screen it will just stop, but maybe we can add a special effect to this, like the iPhone menu bounce!  Another idea is to warp the screen outward so it "wraps around" your vision, like a projector cave, the head-tracking then pans your view around this curved screen, but on most normal movies you will miss important things, and your neck will get very tired! 

I don't actually think we need to recalculate the light bars in real time, I think it will be ok to always calculate them from the outside edge of the base video, the difference is so small you will not notice it.  This is true for the top and bottom bars anyway, which have to be very large because of the aspect-ratio of the Rift screen (4:5).  I think to create the side bars we could just apply a "frosted glass" effect to the base video because it will fill the whole horizontal axis anyway, but we can still use SVP for the sides if it looks better to match the other bars.

ps - Do you have an experience with the Direct3D video renderers?  I have only ever seen them used in media players to stop tearing problems.

Thanks     I found the thread about custom profile but I have not been able to get it working yet, I will keep trying, for the Rift we just need a profile for half the horizontal resolution reported by the display (because it is side by side).  But that is an easy fix, the main thing I need help with is the pan & scan idea, just changing the aspect ratio of the color bars in real time will not work, because the "screen" will follow your eyes when you move your head!  We need to "zoom in" the video about 20%, to overlay the color bars to make a frame that is 20% smaller than the video resolution, it is this frame that has to move over the video as you move you head.  I think we can do it using the crop feature but it has to be much faster to work with head-tracking, I really don't know where to start with this so any ideas you can give me would be very helpful.

EDIT: This is a photo taken through one "eye" of an early Rift prototype, it should give you an idea.

Note - It looks very bad for several reasons: the image is not filling the LCD (aspect ratio problem) the lens is too far from the screen, the camera is not in the correct eye position, and there is very strong moire pattern, don't worry the pixels will not look that bad in the final rift.

I think he wants to use the audio stream as a reference, to lock the positions of the "real" frames, because it is very important to keep the left and right eyes in sync for 3D.  It might be easier to do some tests with SVP, if he uses DirectShowSource in the avisynth script he is using for DeFish warping then SVP manager should intercept it automatically, it has an option for "variable frame-rate repair" so maybe that would work?  It is just an idea though, it is probably better to do it  in a separate step using the script you posted for MVTools 2.5.

PS - Have you had any time to think about my idea in the 3D support thread?

Please let me know if I can explain anything better, about how the Rift HMD works etc.

thanks

Hi, I got it working!     I could not get any side bars for a long time with the script you posted, I am not very experienced with avisynth but in the end I worked out it was an aspect ratio problem, then I had to find a way to over-ride super's smoothfps_params to set both aspect ratios.  It is hard to find the correct balance for both on different video / screen resolutions, maybe you could add some sliders to the GUI in a future release?  I am still doing some tests to find the best way to blur / soften the hard edges, but if you have any ideas on that it would be helpful. 

Also, to make the Rift HMD head-tracking work with SVP we will need an interface to control zoom/crop and pan & scan from SVP itself, because we only want to effect the video window, so we can not use the player's controls or this will also include the colored bars.  I posted some quick videos, but they are very low quality, and you will probably think it looks very strange!    The warping and video aspect ratio are not 100% correct yet but this is actually the kind of output we need to watch "normal" 2D/3D video through the Rift HMD optics:

http://www.youtube.com/watch?v=nFlRHRXdHqw
http://www.youtube.com/watch?v=FU-9D9ATQps

I will also be posting updates in the MTBS thread if you are interested:

http://www.mtbs3d.com/phpBB/viewtopic.p … 825#p86825

thanks

Great, I am on a work PC at the moment but will try it out ASAP. 

What do you think about the blended mirror overlay idea to soften the edges?

3D (MVC), 4K, SHV, 120Hz etc

So OpenCL is not magic after all, I suppose we just need to wait for faster CPUs, finally something to make use of all those cores. 

I thought SVPflow did both 1 & 2, there must still be some elements of these that can no be off-loaded to OpenCL.

So what is eating all these CPU cycles ?!  What else is left -  AVIsynth?

I don't think there is any chance of porting that to OpenCL any time soon!

Thanks for replying, the problem is that the Rift HMD is designed for games and so it has a huge FOV, so compared to HMDs designed for movies (like the Sony HMZ1 etc) the movie screen is actually too big!  For normal video content we have to scale it down onto a "smaller" virtual screen, but it will still be IMAX size!  I want to try and use an AmbiLght type effect to fill the rest of the FOV (peripheral vision) and SVP seems perfect for this.