Evaluating the capacity of deep generative models to reproduce measurable high-order spatial arrangements in diagnostic images

Rucha Deshpande; Mark A. Anastasio; Frank J. Brooks

doi:10.1117/12.2611807

4 April 2022 Evaluating the capacity of deep generative models to reproduce measurable high-order spatial arrangements in diagnostic images

Rucha Deshpande, Mark A. Anastasio, Frank J. Brooks

Author Affiliations +

Proceedings Volume 12032, Medical Imaging 2022: Image Processing; 120321X (2022) https://doi.org/10.1117/12.2611807
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

Given the recent interest in the role of deep generative models (DGM) in medical imaging pipelines, it is imperative to evaluate the capacity of such models to generate medically accurate images. Popular methods of evaluation of natural images generated using generative adversarial networks (GANs), a type of DGM, are often applied to medical data. Such methods are insufficient to evaluate anatomical realism, representations of which include high-order spatial information. To our knowledge, no test exists for the faithful replication of spatial statistics beyond the second-order. In this work, purposefully designed stochastic object models (SOMs) are proposed to encode predetermined rules governing the prevalence of features within single images, thus encoding known high-order spatial information within each realization. These SOMs are independent of the network architecture being tested and can also be applied to any new architecture that may be proposed. Two popular GANs are trained on these SOM datasets and the generated images are tested for the encoded statistics. It is observed that although ensemble statistics might be well replicated, this is not necessarily true for realization i.e., per-image statistics. Thus, GAN-generated images might not be ready for clinical use. With the proposed SOMs, the rate of image errors and the rate of feature malformation can be quantified for any architecture, while providing one measure of GAN utility in a diagnostic scenario.

Citation Download Citation

Rucha Deshpande, Mark A. Anastasio, and Frank J. Brooks "Evaluating the capacity of deep generative models to reproduce measurable high-order spatial arrangements in diagnostic images", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 120321X (4 April 2022); https://doi.org/10.1117/12.2611807

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available