Stereo-vision-based mixed reality: assistance for teleoperation

Didier Maman; Fawzi Nashashibi; Philippe Fuchs; Jean Claude Bordas

doi:10.1117/12.333671

18 December 1998 Stereo-vision-based mixed reality: assistance for teleoperation

Didier Maman, Fawzi Nashashibi, Philippe Fuchs, Jean Claude Bordas

Proceedings Volume 3524, Telemanipulator and Telepresence Technologies V; (1998) https://doi.org/10.1117/12.333671
Event: Photonics East (ISAM, VVDC, IEMB), 1998, Boston, MA, United States

Abstract

This paper deals with the use of mixed reality as a new assistance and training tool for performign teleoperation tasks in hostile environments. It describes the virtual reality techniques invovled and tackles the proble of scene registration using a man-machine cooperative and multisensory vision system. During a maintenance operation, a telerobotic task needs a perfect knowledge of the remote scne in which the robot operates. Therefore, the system provides the operator with pwoerful sensorial feedbacks as well as appropriate tools to build and update automatically the geometric model of the perceived scene. This local model is the world over which the robot is working. It also serves for mission traiing or planning an dpermits any viewpoint observation. We will describe here a new interactive approach combining image analysis and mixed reality technqiues for assisted 3D geometric semantic modling. We also tackle the problem of pose recovery and object tracking using a stereosocpic system mounted on a robot arm. The proposed model-based approach can be used for both real-time tracking and accurate static fitting of complex parametric curved objects. It therefore constitutes a unified tool for building and maintaining the local geometric model of the remote environment.

Citation Download Citation

Didier Maman, Fawzi Nashashibi, Philippe Fuchs, and Jean Claude Bordas "Stereo-vision-based mixed reality: assistance for teleoperation", Proc. SPIE 3524, Telemanipulator and Telepresence Technologies V, (18 December 1998); https://doi.org/10.1117/12.333671

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available