Light field saliency object detection based on self-selected multimodal fusion

Hongjie Wu; Dan Xu

doi:10.1117/12.3005914

10 October 2023 Light field saliency object detection based on self-selected multimodal fusion

Hongjie Wu, Dan Xu

Proceedings Volume 12799, Third International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2023); 127993A (2023) https://doi.org/10.1117/12.3005914
Event: 3rd International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2023), 2023, Kuala Lumpur, Malaysia

Abstract

Saliency detection of light field images is a key technology in applications such as visual tracking, target detection and image compression. Existing light field saliency target detection tends to ignore the complementarity of cross-mode light field data, inevitably introducing redundant information and leading to blurred salient images. Even in similar or confusing scenes, there are problems such as incomplete detection objects and difficult background suppression. To this end, this paper proposes an image saliency detection network based on self-selective cross-modal feature fusion. Firstly, hierarchical features are extracted from the backbone network, and each modal feature is optimized based on the attention mechanism using the spatial alignment and channel rescaling modules, and then the two modal features are fused to obtain a more accurate saliency map guided by edge information. Experimental results on the latest light field dataset show that this method outperforms the comparison method both quantitatively and qualitatively.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Hongjie Wu and Dan Xu "Light field saliency object detection based on self-selected multimodal fusion", Proc. SPIE 12799, Third International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2023), 127993A (10 October 2023); https://doi.org/10.1117/12.3005914

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
5 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Object detection

Image fusion

Feature extraction

Feature fusion

Target detection

Convolution

3D modeling

Show All Keywords

Keywords/Phrases

Search In:

Publication Years