Multiple motion and occlusion segmentation with a multiphase level set method

Yonggang Shi; Janusz Konrad; William Clem Karl

doi:10.1117/12.525144

18 January 2004 Multiple motion and occlusion segmentation with a multiphase level set method

Yonggang Shi, Janusz Konrad, William Clem Karl

Proceedings Volume 5308, Visual Communications and Image Processing 2004; (2004) https://doi.org/10.1117/12.525144
Event: Electronic Imaging 2004, 2004, San Jose, California, United States

Abstract

In this paper, we propose a new variational formulation for simultaneous multiple motion segmentation and occlusion detection in an image sequence. For the representation of segmented regions, we use the multiphase level set method proposed by Vese and Chan. This method allows an efficient representation of up to 2^L regions with L level-set functions. Moreover, by construction, it enforces a domain partition with no gaps and overlaps. This is unlike previous variational approaches to multiple motion segmentation, where additional constraints were needed. The variational framework we propose can incorporate an arbitrary number of motion transformations as well as occlusion areas. In order to minimize the resulting energy, we developed a two-step algorithm. In the first step, we use a feature-based method to estimate the motions present in the image sequence. In the second step, based on the extracted motion information, we iteratively evolve all level set functions in the gradient descent direction to find the final segmentation. We have tested the above algorithm on both synthetic- and natural-motion data with very promising results. We show here segmentation results for two real video sequences.

Citation Download Citation

Yonggang Shi, Janusz Konrad, and William Clem Karl "Multiple motion and occlusion segmentation with a multiphase level set method", Proc. SPIE 5308, Visual Communications and Image Processing 2004, (18 January 2004); https://doi.org/10.1117/12.525144

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available