Centralized tracking and bidirectional long short-term memory for abnormal behaviour recognition

Maria Andersson

doi:10.1117/12.2641861

28 October 2022 Centralized tracking and bidirectional long short-term memory for abnormal behaviour recognition

Maria Andersson

Proceedings Volume 12275, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies VI; 122750H (2022) https://doi.org/10.1117/12.2641861
Event: SPIE Security + Defence, 2022, Berlin, Germany

Abstract

The contribution of this paper is an evaluation of the chain of calculations for a behaviour recognition method. That is, from person detection, centralized person tracking to a bi-directional long short-term memory (BiLSTM). The centralized person tracking fuses detections from distributed and multimodal sensors. The BiLSTM learns long-time dependencies in the tracking data sequences. We use experimental sensor data from visual and thermal infrared sensors. The sensor data describe five scenarios with people performing normal and abnormal behaviours. The results indicate that the mean recognition accuracy is rather high. However, with position as the only input data, the robustness of the method is rather low. The robustness increases by adding velocity to the dataset. Velocity adds important information, even though velocity appears very messy when visualized in diagrams. Furthermore, the BiLSTM is compared with the unidirectional long short-term memory (LSTM) and the gated recurrent unit (GRU).

Conference Presentation

Citation Download Citation

Maria Andersson "Centralized tracking and bidirectional long short-term memory for abnormal behaviour recognition", Proc. SPIE 12275, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies VI, 122750H (28 October 2022); https://doi.org/10.1117/12.2641861

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available