Immersive remote monitoring of urban sites

Rakesh Kumar; Harpreet S. Sawhney; Aydin Arpa; Supun Samarasekera; Manoj Aggrawal; Stephen Hsu; D. Nister; Keith Hanna

doi:10.1117/12.478715

6 August 2002 Immersive remote monitoring of urban sites

Rakesh Kumar, Harpreet S. Sawhney, Aydin Arpa, Supun Samarasekera, Manoj Aggrawal, Stephen Hsu, D. Nister, Keith Hanna

Proceedings Volume 4741, Battlespace Digitization and Network-Centric Warfare II; (2002) https://doi.org/10.1117/12.478715
Event: AeroSense 2002, 2002, Orlando, FL, United States

Abstract

In a typical security and monitoring system a large number of networked cameras are installed at fixed positions around a site under surveillance. There is generally no global view or map that shows the guard how the views of different cameras relate to one another. Individual cameras may be equipped with pan, tilt and zoom capabilities, and the guard may be able to follow an intruder with one camera, then pick him up with another. But such tracking can be difficult, and hand off between cameras disorienting. The guard does not have the ability to continually shift his viewpoint. More over current systems do not scale up with the number of cameras. The system becomes more unwieldy as cameras are added to the system. In this paper, we will present the system and key algorithms for remote immersive monitoring of an urban site using a blanket of video cameras. The guard monitors the world using a live 3D model, which is constantly being updated from different directions using the multiple video streams. The world can be monitored remotely from any virtual viewpoint. The observer can see the entire scene from far and get a bird's eye view or can fly/zoom in and see activity of interest up close. A 3D-site model is constructed of the urban site and used as glue for combining the multiple video streams. Moreover each of the video cameras has smart image processing associated with it, which allows it to detect moving and new objects in the scene and recover their 3D geometry and pose of the camera with respect to the world model. Each video stream is overlaid on top of the video model using the recovered pose. Virtual views of the scene are generated by combining the various video streams, the background 3D model and the recovered 3D geometry of foreground objects. These moving objects are highlighted on the 3D model and used as a cue by the operator to direct his viewpoint.

Citation Download Citation

Rakesh Kumar, Harpreet S. Sawhney, Aydin Arpa, Supun Samarasekera, Manoj Aggrawal, Stephen Hsu, D. Nister, and Keith Hanna "Immersive remote monitoring of urban sites", Proc. SPIE 4741, Battlespace Digitization and Network-Centric Warfare II, (6 August 2002); https://doi.org/10.1117/12.478715

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available