Paper
5 October 2021 RGB-infrared fusion tracking algorithm based on Siamese network
Ruyou Li, Wennan Cui, Zhiyong Wang, Jingjing Zhang
Author Affiliations +
Proceedings Volume 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning; 119111H (2021) https://doi.org/10.1117/12.2604555
Event: 2nd International Conference on Computer Vision, Image and Deep Learning, 2021, Liuzhou, China
Abstract
The target tracking method based on RGB image is affected by many factors such as light and haze weather, so it is difficult to distinguish the tracking target from the background, and it is easy to lead to the drift or even loss of the tracking target. Target tracking based on infrared images is not affected by light, haze and other illumination factors, but the target's color, texture and other characteristic information will be missing. Therefore, in order to obtain the target's color, texture and other characteristic information in a poorly illuminated environment, while achieving accurate and fast tracking of the object, this paper proposes a RGB and infrared image fusion tracking method based on a deep convolutional network. Firstly, the fusion method of RGB and infrared images is studied; secondly, a target tracking network based on the Siamese network is established to extract the image convolution features of the target template and the current target; finally, the response map is calculated by the deep cross-correlation module. At last, the performance test of the target tracking algorithm is carried out on the VOT2019RGBT data set. Experimental results show that the algorithm can effectively solve the problem of target tracking when the target is partially occluded, the tracking scene has no suitable illumination or the light changes strongly, and it is of great significance to improve the accuracy of target tracking under complex backgrounds.
© (2021) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Ruyou Li, Wennan Cui, Zhiyong Wang, and Jingjing Zhang "RGB-infrared fusion tracking algorithm based on Siamese network", Proc. SPIE 11911, 2nd International Conference on Computer Vision, Image, and Deep Learning, 119111H (5 October 2021); https://doi.org/10.1117/12.2604555
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Detection and tracking algorithms

Infrared imaging

Convolutional neural networks

Infrared search and track

Network architectures

Back to Top