24 August 2022 Fusion of hyperspectral and LiDAR data using sparse stacked autoencoder for land cover classification with 3D-2D convolutional neural network
Manoj Kumar K. Singh, Shashank Mohan, Brajesh Kumar
Author Affiliations +
Abstract

Fusion of complementary information from multisensor data is of great importance for identifying the land covers. However, integration of multisource information is a challenging task. A framework is developed to integrate hyperspectral and LiDAR data for land cover classification. In the proposed method, sparse stacked autoencoders are used to represent the spectral and spatial information in a compact form. The spatial information is extracted both from hyperspectral and LiDAR data using morphological operators. The encoded spectral and spatial features are combined with elevation information to form a joint feature vector. The joint features are fed to a convolutional neural network (CNN) classifier to classify the land covers. The CNN classifier is a hybrid three- and two-dimensional (3D)–(2D) model having three 3D convolutional layers and one 2D convolutional layer. The experiments are carried out on two datasets Houston and Samford to evaluate the performance of the proposed method. The results have demonstrated the effectiveness of the method with global κ = 0.9285 and global naive accuracy (OA) of 93.44% for Houston data. For Samford data, it achieves κ = 0.9811 and OA = 98.93 % .

© 2022 Society of Photo-Optical Instrumentation Engineers (SPIE)
Manoj Kumar K. Singh, Shashank Mohan, and Brajesh Kumar "Fusion of hyperspectral and LiDAR data using sparse stacked autoencoder for land cover classification with 3D-2D convolutional neural network," Journal of Applied Remote Sensing 16(3), 034523 (24 August 2022). https://doi.org/10.1117/1.JRS.16.034523
Received: 2 April 2022; Accepted: 5 August 2022; Published: 24 August 2022
Lens.org Logo
CITATIONS
Cited by 7 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
LIDAR

Data fusion

Hyperspectral imaging

3D modeling

Image fusion

Feature extraction

Information fusion

Back to Top