Tracking of object deformations in color and depth video: deformation models and applications

Andreas Jordt; Stefan Reinhold; Reinhard Koch

doi:10.1117/12.2190780

21 June 2015 Tracking of object deformations in color and depth video: deformation models and applications

Andreas Jordt, Stefan Reinhold, Reinhard Koch

Proceedings Volume 9528, Videometrics, Range Imaging, and Applications XIII; 95280J (2015) https://doi.org/10.1117/12.2190780
Event: SPIE Optical Metrology, 2015, Munich, Germany

Abstract

The research on deformation tracking based on color image data has continuously gained a wide interest in the last 15 years. In addition, using depth sensors such as the Microsoft Kinect, allows to mitigate the ambiguity problems that arise when trying to solve the deformation tracking tasks on color images only, by adding depth information. However, the fusion of color and depth data is not straight forward, and the deformation tracking task is still ill-posed due to the lack of a general deformation model. The problem is usually circumvented by providing special deformation functions for the task at hand, e.g., skeleton-based for reconstructing people or triangle-based for tracking planar surfaces. In this article we summarize the Analysis by Synthesis (AbS) approach for deformation tracking in depth and color video and show some successful applications of specialized deformation functions. To overcome the issues with NURBS based deformation tracking we propose a new geodesic RBF-based deformation model, which can adapt to any surface topology and shape, while keeping the number of deformation parameters low. Example deformations for objects of different topologies are given, showing the versatility and efficiency of the proposed model.

Citation Download Citation

Andreas Jordt, Stefan Reinhold, and Reinhard Koch "Tracking of object deformations in color and depth video: deformation models and applications", Proc. SPIE 9528, Videometrics, Range Imaging, and Applications XIII, 95280J (21 June 2015); https://doi.org/10.1117/12.2190780

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available