Semantic segmentation of urban areas using relabeled heterogeneous unmanned aerial datasets and combined deep learning network

A. Song

doi:10.1117/12.3005536

20 September 2023 Semantic segmentation of urban areas using relabeled heterogeneous unmanned aerial datasets and combined deep learning network

A. Song

Author Affiliations +

Proceedings Volume 12607, Optical Technology and Measurement for Industrial Applications Conference; 126070C (2023) https://doi.org/10.1117/12.3005536
Event: Optics and Photonics International Congress, 2023, Yokohama, Japan

Abstract

Unmanned aerial vehicles (UAVs) can overcome several limitations of satellite and aerial platforms using their multiple visit ability. However, UAVs usually collect images of small and simple regions from a large image scene and obtain high-resolution images from various viewing angles and altitudes. Multiple datasets created in various regions and conditions can be helpful considering data expansion to improve the usability of the UAV datasets with deep learning. The combined segmentation network (CSN), which can train two datasets simultaneously by sharing encoding blocks, was used to segment heterogeneous UAV datasets, such as UAVid and semantic drone dataset. CSN shared encoding blocks to learn general features from two datasets and decoding blocks trained separately on each dataset. For the preprocessing step, classes of each dataset were adjusted to minimize the difference between the two datasets. Experiment results show that CSN can segment more accurately for specific classes, such as background and vegetation, which have low ratios in the single dataset. This study presented the potential application of integrated heterogeneous UAV imagery datasets by learning shared layers. Thus, surface inspection would be effectively conducted using UAV datasets.

Citation Download Citation

A. Song "Semantic segmentation of urban areas using relabeled heterogeneous unmanned aerial datasets and combined deep learning network", Proc. SPIE 12607, Optical Technology and Measurement for Industrial Applications Conference, 126070C (20 September 2023); https://doi.org/10.1117/12.3005536

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available