A deep learning-based computational prediction model for characterizing cellular biomarker distribution in tumor microenvironment

Zhengyao Peng; Chang Bian; Yang Du; Jie Tian

doi:10.1117/12.2610640

4 April 2022 A deep learning-based computational prediction model for characterizing cellular biomarker distribution in tumor microenvironment

Zhengyao Peng, Chang Bian, Yang Du, Jie Tian

Author Affiliations +

Proceedings Volume 12039, Medical Imaging 2022: Digital and Computational Pathology; 120391H (2022) https://doi.org/10.1117/12.2610640
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

Evaluation of cancer cell and immune cell distribution in tumor microenvironment (TME) is one of the most important factors for guiding cancer immunotherapy and assessing therapeutic response. Multiplexed immunohistochemistry (mIHC) is often used to obtain the different types of cellular biomarker expression and distribution information in TME, but mIHC is limited by time-consuming and cost-intensive, and pathologists’ objectives etc. In this work, we proposed a deep learning-based modified U-Net (m-Unet), by replacing the original convolution sub-module with a modified block to predict the distribution of several typical cellular biomarkers’ expression and distribution information in TME. We have demonstrated that our model can be trained in both fully supervised and semi-supervised manners. The model can extract segmentation information from Hematoxylin and Eosin (H&E) images, and predict the cellular biomarker distributions including panCK for colon cancer cells, CD3 and CD20 for tumor infiltrating lymphocytes (TILs) and DAPI for nucleus. We have demonstrated that our model can be trained in both fully supervised and semi-supervised manners and. the performance of the m-Unet is better than the U-Net in this work. The optimal prediction accuracy of m-Unet is 88.3% on the test dataset. In general, this model possesses the potential to assist the clinical TME analysis.

Conference Presentation

Citation Download Citation

Zhengyao Peng, Chang Bian, Yang Du, and Jie Tian "A deep learning-based computational prediction model for characterizing cellular biomarker distribution in tumor microenvironment", Proc. SPIE 12039, Medical Imaging 2022: Digital and Computational Pathology, 120391H (4 April 2022); https://doi.org/10.1117/12.2610640

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available