Depth keying

Ronen Gvili; Amir Kaplan; Eyal Ofek; Giora Yahav

doi:10.1117/12.474052

30 May 2003 Depth keying

Ronen Gvili, Amir Kaplan, Eyal Ofek, Giora Yahav

Proceedings Volume 5006, Stereoscopic Displays and Virtual Reality Systems X; (2003) https://doi.org/10.1117/12.474052
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

We present a new solution to the known problem of video keying in a natural environment. We segment foreground objects from background objects using their relative distance from the camera, which makes it possible to do away with the use of color for keying. To do so, we developed and built a novel depth video camera, capable of producing RGB and D signals, where D stands for the distance to each pixel. The new RGBD camera enables the creation of a whole new gallery of effects and applications such as multi-layer background substitutions. This new modality makes the production of real time mixed reality video possible, as well as post-production manipulation of recorded video. We address the problem of color spill -- in which the color of the foreground object is mixed, along its boundary, with the background color. This problem prevents an accurate separation of the foreground object from its background, and it is most visible when compositing the foreground objects to a new background. Most existing techniques are limited to the use of a constant background color. We offer a novel general approach to the problem with enabling the use of the natural background, based upon the D channel generated by the camera.

Citation Download Citation

Ronen Gvili, Amir Kaplan, Eyal Ofek, and Giora Yahav "Depth keying", Proc. SPIE 5006, Stereoscopic Displays and Virtual Reality Systems X, (30 May 2003); https://doi.org/10.1117/12.474052

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available