A robust target recognition and tracking panoramic surveillance system based on deep learning

Qiang Fan; ErBo Zou

doi:10.1117/12.2536611

20 November 2019 A robust target recognition and tracking panoramic surveillance system based on deep learning

Qiang Fan, ErBo Zou

Proceedings Volume 11192, Real-time Photonic Measurements, Data Management, and Processing IV; 111920Y (2019) https://doi.org/10.1117/12.2536611
Event: SPIE/COS Photonics Asia, 2019, Hangzhou, China

Abstract

A panoramic monitoring system is designed to achieve continuous monitoring of the surrounding environment. The image acquisition module of the system is composed of five fixed-focal-length cameras and a variable-focal-length camera, which realizes 360 degree environmental monitoring. Usually, the background of continuous photography changes due to fluctuations of ambient light, humidity and wind. Therefore, a dynamic adaptive threshold is used to dynamically update the background template in order to better accommodate various weather changes. Further, a motion-aware algorithm based on background updates is applied to effectively detect whether an intruding target exists and determine the direction of the target. Once an intrusive target is found, the deep convolution neural network Yolo is employed to recognize the target quickly. It shows the advantages of less computation and preferable detection accuracy. In addition, according to the preset warning level, when the intrusion target needs to be alarmed, the target orientation is transmitted to the platform through the central control processing unit, so that the variable-focal-length camera can take real-time snapshots. we propose an end-to-end lightweight siamese convolution neural network to achieve fast and robust target tracking. The network structure replaces the hand-crafted features by the multi-layers deep convolution features of the target, so that higher precision can be achieved. The experiment result shows panoramic surveillance system can effectively and robustly perform security tasks such as panoramic imaging, target recognition and fast target tracking.

Citation Download Citation

Qiang Fan and ErBo Zou "A robust target recognition and tracking panoramic surveillance system based on deep learning", Proc. SPIE 11192, Real-time Photonic Measurements, Data Management, and Processing IV, 111920Y (20 November 2019); https://doi.org/10.1117/12.2536611

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Target recognition

Panoramic photography

Surveillance systems

Cameras

Convolution

Environmental monitoring

Imaging systems

Show All Keywords

Keywords/Phrases

Search In:

Publication Years