Incorporating minimal user input into deep-learning-based image segmentation

Maysam Shahedi; Martin Halicek; James D. Dormer; Baowei Fei

doi:10.1117/12.2549716

10 March 2020 Incorporating minimal user input into deep-learning-based image segmentation

Maysam Shahedi, Martin Halicek, James D. Dormer, Baowei Fei

Proceedings Volume 11313, Medical Imaging 2020: Image Processing; 1131313 (2020) https://doi.org/10.1117/12.2549716
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

Computer-assisted image segmentation techniques could help clinicians to perform the border delineation task faster with lower inter-observer variability. Recently, convolutional neural networks (CNNs) are widely used for automatic image segmentation. In this study, we used a technique to involve observer inputs for supervising CNNs to improve the accuracy of the segmentation performance. We added a set of sparse surface points as an additional input to supervise the CNNs for more accurate image segmentation. We tested our technique by applying minimal interactions to supervise the networks for segmentation of the prostate on magnetic resonance images. We used U-Net and a new network architecture that was based on U-Net (dual-input path [DIP] U-Net), and showed that our supervising technique could significantly increase the segmentation accuracy of both networks as compared to fully automatic segmentation using U-Net. We also showed DIP U-Net outperformed U-Net for supervised image segmentation. We compared our results to the measured inter-expert observer difference in manual segmentation. This comparison suggests that applying about 15 to 20 selected surface points can achieve a performance comparable to manual segmentation.

Conference Presentation

Citation Download Citation

Maysam Shahedi, Martin Halicek, James D. Dormer, and Baowei Fei "Incorporating minimal user input into deep-learning-based image segmentation", Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 1131313 (10 March 2020); https://doi.org/10.1117/12.2549716

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available