Applying deep learning to enhance person detection in maritime images

Cornelia Nita; Simon Rennotte; Marijke Vandewal

doi:10.1117/12.3031660

13 November 2024 Applying deep learning to enhance person detection in maritime images

Cornelia Nita, Simon Rennotte, Marijke Vandewal

Author Affiliations +

Proceedings Volume 13206, Artificial Intelligence for Security and Defence Applications II; 132060B (2024) https://doi.org/10.1117/12.3031660
Event: Security + Defence, 2024, Edinburgh, United Kingdom

Abstract

The application of sensor data obtained from patrol ships, drones, and specific coastal locations may contribute to the development of effective and scalable monitoring systems for enhancing coastal security and maritime domain awareness. Typically, daytime surveillance relies on high-resolution images captured by visible sensors, whereas infrared imaging can be employed under low-visibility conditions. In this study, we focus on a critical aspect of maritime surveillance: deep learning-based person detection. The collected datasets included visible and infrared images of passengers on ships, offshore wind turbine decks, and people in water. In addition, vessel classification was considered. To exploit both spectral domains, we applied a preprocessing strategy to the thermal data, transforming the infrared images to resemble the visible ones. We fine-tuned the detector using this data. Our findings show that the deep learning model can effectively distinguish between human and vessel signatures, despite challenges such as low pixel resolution, cluttered backgrounds, and varying postures of individuals. Moreover, our results suggest that the extracted features from the infrared data significantly improve the detector’s performance in the visible domain by using appropriate preprocessing techniques. However, we observed a limited transferability of models that have been pre-trained on visible images to the infrared spectral domain.

Conference Presentation

Citation Download Citation

Cornelia Nita, Simon Rennotte, and Marijke Vandewal "Applying deep learning to enhance person detection in maritime images", Proc. SPIE 13206, Artificial Intelligence for Security and Defence Applications II, 132060B (13 November 2024); https://doi.org/10.1117/12.3031660

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE