Progressively growing convolutional networks for end-to-end deformable image registration

Koen A. J. Eppenhof; Maxime W. Lafarge; Josien P. W. Pluim

doi:10.1117/12.2512428

15 March 2019 Progressively growing convolutional networks for end-to-end deformable image registration

Koen A. J. Eppenhof, Maxime W. Lafarge, Josien P. W. Pluim

Proceedings Volume 10949, Medical Imaging 2019: Image Processing; 109491C (2019) https://doi.org/10.1117/12.2512428
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Deformable image registration is often a slow process when using conventional methods. To speed up deformable registration, there is growing interest in using convolutional neural networks. They are comparatively fast and can be trained to estimate full-resolution deformation fields directly from pairs of images. Because deep learningbased registration methods often require rigid or affine pre-registration of the images, they do not perform true end-to-end image registration. To address this, we propose a progressive training method for end-to-end image registration with convolutional networks. The network is first trained to find large deformations at a low resolution using a smaller part of the full architecture. The network is then gradually expanded during training by adding higher resolution layers that allow the network to learn more fine-grained deformations from higher resolution data. By starting at a lower resolution, the network is able to learn larger deformations more quickly at the start of training, making pre-registration redundant. We apply this method to pulmonary CT data, and use it to register inhalation to exhalation images. We train the network using the CREATIS pulmonary CT data set, and apply the trained network to register the DIRLAB pulmonary CT data set. By computing the target registration error at corresponding landmarks we show that the error for end-to-end registration is significantly reduced by using progressive training, while retaining sub-second registration times.

Conference Presentation

Citation Download Citation

Koen A. J. Eppenhof, Maxime W. Lafarge, and Josien P. W. Pluim "Progressively growing convolutional networks for end-to-end deformable image registration", Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 109491C (15 March 2019); https://doi.org/10.1117/12.2512428

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available