Suitable matching area selection for aircraft navigation based on multi-modal information fusion

Jiwei Deng; Liang Zhou; Chao Yang; Junyu Wang; Yuanxin Ye

doi:10.1117/12.2691232

7 March 2024 Suitable matching area selection for aircraft navigation based on multi-modal information fusion

Jiwei Deng, Liang Zhou, Chao Yang, Junyu Wang, Yuanxin Ye

Proceedings Volume 13086, MIPPR 2023: Pattern Recognition and Computer Vision; 1308608 (2024) https://doi.org/10.1117/12.2691232
Event: Twelfth International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2023), 2023, Wuhan, China

Abstract

Suitable matching area selection (SMAS) is one of the key technologies for aircraft scene matching navigation (SMN). Recently, deep neural networks have been applied to SMAS due to their powerful feature extraction capabilities, and have achieved significant performance improvements compared to hand-crafted suitable matching indicators. However, SMAS solely based on deep networks does not make full use of existing image suitability information. Therefore, this paper constructs a dual-branch multi-modal fusion network to maximize the utilization of image suitability features to improve SMAS performance. The network contains two parallel channels, one of which takes hand-crafted suitable matching indicators as input, and uses natural language processing networks to obtain deep suitable matching parameter vectors, and the other employs deep networks to extract deep features from original image patches. Finally, the two types of multi-modal information are fused to produce multi-modal suitable matching features (MMSMF), which is input to the output layer to predict the matching probability. By setting a matching probability threshold, we can distinguish between suitable and unsuitable matching image patches. Compared with traditional hand-crafted suitable matching indicators and deep networks, MMSMF can yield richer suitability feature representation. The public Sentinel dataset named SEN1-2 is used to evaluate the performance of MMSMF. Experimental results show its advantages over other representative methods.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Jiwei Deng, Liang Zhou, Chao Yang, Junyu Wang, and Yuanxin Ye "Suitable matching area selection for aircraft navigation based on multi-modal information fusion", Proc. SPIE 13086, MIPPR 2023: Pattern Recognition and Computer Vision, 1308608 (7 March 2024); https://doi.org/10.1117/12.2691232

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available