RGB-T object tracking with adaptive decision fusion

Yida Bai; Ming Yang

doi:10.1117/12.2679107

8 May 2023 RGB-T object tracking with adaptive decision fusion

Yida Bai, Ming Yang

Proceedings Volume 12635, Second International Conference on Algorithms, Microchips, and Network Applications (AMNA 2023); 126350X (2023) https://doi.org/10.1117/12.2679107
Event: International Conference on Algorithms, Microchips, and Network Applications 2023, 2023, Zhengzhou, China

Abstract

Visual object tracking is a traditional task in computer vision, which has developed with several decades. With the development of machine learning, Correlation Filter (CF) has been proposed with satisfying performance and very high framerate. Though the CF framework has numerous strengths in this task, the tracker is fragile to miss the target in several scenes, including extreme illumination, target occlusion and deformation. Recently, thermal modality, which detects the target’s temperature, is robust to the night scenes and can provide a precise target contour. In this paper, we propose a CF based tracker with decision fusion strategy for visible-thermal (RGB-T) tracking. First, we introduce multi-modal KCF trackers as our baseline. Then, we design a decision fusion method considering the Peak-to-Side Rate (PSR) of the score maps, thereby achieving an adaptive fusing those modalities and avoiding model’s heterogeneity. In the experiments, our tracker has validated on the public dataset, namely GTOT. Compared with two uni-modality trackers, the proposed tracker with real-time speed has shown superior results on both target localization and scale estimation.

Citation Download Citation

Yida Bai and Ming Yang "RGB-T object tracking with adaptive decision fusion", Proc. SPIE 12635, Second International Conference on Algorithms, Microchips, and Network Applications (AMNA 2023), 126350X (8 May 2023); https://doi.org/10.1117/12.2679107

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available