• Thanks: 3

Topic: Segmentation

What about applying a real-time segmentation algorithm on the motion vectors to find the different "objects of the scene" so we could blend their motion vectors one object at time without impacting near objects (number of objects handled would be a setting).

Maybe using different motion vector sizes at same time would help to catch local and more global movements.

A Other idea would be to use un-linear motion vectors like cubic, spline...

I would like to know what you guys think theses, what would be the cost and gain to implement thems etc.

Great work !

  • MAG79
  • SVP developer
  • Offline

Re: Segmentation

acidmanvl
SVP uses Block-matching algorithm.

Do you know fast and ready-to-use real-time segmentation algorithm?
We are not.

Maybe using different motion vector sizes at same time would help to catch local and more global movements
May be you talk about block sizes (not vector sizes)?

acidmanvl
to use un-linear motion vectors like cubic, spline
Do you have computer quick enough for this?

The main task of SVP is real-time frame interpolation.

  • Thanks: 3

Re: Segmentation

MAG79
Do you know fast and ready-to-use real-time segmentation algorithm?
We are not.
acidmanvl
No idea right now, this for sure is a big subject and could be done into a other tool.

I though more about it and maybe you could just do simple contour detection to prevent blending over contours
Do you know what part of the process is making artifacts ?

MAG79
May be you talk about block sizes (not vector sizes)?
acidmanvl
Nm... can you explain a bit more the block matching algo ?  Is it a iterative algorithm or a one pass that find the closest matching block, does it look for a optimal solution ?

acidmanvl
to use un-linear motion vectors like cubic, spline

MAG79
Do you have computer quick enough for this?
acidmanvl
Resolving quadratic curve is would not be so costly. But need 3 points instead of 2