AMBrnet: asymmetric multi-branch residual network for LiDAR semantic segmentation

Zizhong Wei; Fengshan Zou; Shengran Qin; Li Zhang

doi:10.1117/12.2661083

2 February 2023 AMBrnet: asymmetric multi-branch residual network for LiDAR semantic segmentation

Zizhong Wei, Fengshan Zou, Shengran Qin, Li Zhang

Proceedings Volume 12462, Third International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022); 1246223 (2023) https://doi.org/10.1117/12.2661083
Event: International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022), 2022, Xi'an, China

Abstract

Existing point-based, sparse voxel-based, or hybrid point cloud processing methods require time-consuming neighborhood searches or sparse 3D convolutions, which consume a lot of time and computational resources. Therefore, it is difficult to run at high speed in real time on mobile devices. To this end, we reconstructed the internal structure based on RangeNet++¹ and designed an efficient and lightweight network named AMBrnet, still using the encoder-decoder architecture. An asymmetric multi-branch aggregation module is designed to directly aggregate the input information and provide rich information for subsequent step encoding. The dual-branch structure is introduced to combine with the encoder and decoder to strengthen the information encoding and decoding capabilities of the network. Weighted cross-entropy loss combined with Lovász-Softmax loss² is used to directly optimize the Jaccard index (IoU). In the network inference stage, structural reparameterization is introduced to ensure that the inference speed is improved based on the same accuracy, reducing the number of network parameters. We evaluate the proposed model on the SemanticKITTI dataset. The prediction accuracy is better than most existing networks, notably its inference speed is up to 43.9 Hz. Experimental data show that AMBrnet is well suited for real-time high-speed point cloud processing on outdoor mobile devices.

Citation Download Citation

Zizhong Wei, Fengshan Zou, Shengran Qin, and Li Zhang "AMBrnet: asymmetric multi-branch residual network for LiDAR semantic segmentation", Proc. SPIE 12462, Third International Symposium on Computer Engineering and Intelligent Communications (ISCEIC 2022), 1246223 (2 February 2023); https://doi.org/10.1117/12.2661083

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Point clouds

Semantics

Convolution

Feature extraction

Education and training

LIDAR

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years