Detection of human interaction from a distance using salient body behaviour modelling

Hayley Hung; Shaogang Gong

doi:10.1117/12.689355

28 September 2006 Detection of human interaction from a distance using salient body behaviour modelling

Hayley Hung, Shaogang Gong

Proceedings Volume 6402, Optics and Photonics for Counterterrorism and Crime Fighting II; 640203 (2006) https://doi.org/10.1117/12.689355
Event: Optics/Photonics in Security and Defence, 2006, Stockholm, Sweden

Abstract

Understanding far and close proximity human-human interaction observed from a distance is a necessary step towards automated suspicious or antisocial behaviour detection. Most previous work on human-human interaction has made the implicit assumption that interactions occur only at immediate spatial and temporal proximity between the subjects concerned. We propose a more realistic application of human-human interaction detection from surveillance data where the subjects of interest tend to be represented by few pixels relative to the rest of the scene. The subjects are represented by relatively few pixels since surveillance cameras are usually placed to maximise area coverage therefore there is a significant distance between the camera and the physical scene. This in itself is not so much of a disadvantage when we consider that interactions among subjects can occur between quite large distances in space. Our technique uses a spatial and temporal saliency measure to extract and select features using modifications to Kadir and Brady's scale saliency and Hung and Gong's temporal saliency algorithms respectively. From this, a hierarchical multi-scale model of a single person, his/her body pose and groups of people is formed. A person is represented by an elliptic blob where prominent oval-shaped parts are formed into a configuration. Interactions are identified by finding temporally correlated salient changes (we call events) in the probability distributions of our multi-scale configuration model. In this paper we will show how pose or configuration based models of the human body can provide a rich framework for modelling human-human interactive body behaviour even when body parts are occluded. In particular, the framework is suitable for extracting salient features from the human body where each part is represented by a few pixels in each image frame. The work is highly relevant to the development of automated systems for suspicious and antisocial behaviour detection and prevention.

Citation Download Citation

Hayley Hung and Shaogang Gong "Detection of human interaction from a distance using salient body behaviour modelling", Proc. SPIE 6402, Optics and Photonics for Counterterrorism and Crime Fighting II, 640203 (28 September 2006); https://doi.org/10.1117/12.689355

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Feature extraction

Surveillance

Modeling

Motion models

Cameras

Detection and tracking algorithms

3D modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years