Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery

Nan Cui; Pradosh Kharel; Viktor Gruev

doi:10.1117/12.2251625

8 February 2017 Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery

Nan Cui, Pradosh Kharel, Viktor Gruev

Author Affiliations +

Proceedings Volume 10049, Molecular-Guided Surgery: Molecules, Devices, and Applications III; 100490I (2017) https://doi.org/10.1117/12.2251625
Event: SPIE BiOS, 2017, San Francisco, California, United States

Abstract

Near infrared fluorescence (NIRF) based image guided surgery aims to provide vital information to the surgeon in the operating room, such as locations of cancerous tissue that should be resected and healthy tissue that should to be preserved. Targeted molecular markers, such as tumor or nerve specific probes, are used in conjunctions with NIRF imaging and display systems to provide key information to the operator in real-time. One of the major hurdles for the wide adaptation of these imaging systems is the high cost to operate the instruments, large footprint and complexity of operating the systems. The emergence of wearable NIRF systems has addressed these shortcomings by minimizing the imaging and display systems’ footprint and reducing the operational cost. However, one of the major shortcomings for this technology is the replacement of the surgeon’s natural vision with an augmented reality view of the operating room. In this paper, we have addressed this major shortcoming by exploiting hologram technology from Microsoft HoloLens to present NIR information on a color image captured by the surgeon’s natural vision. NIR information is captured with a CMOS sensor with high quantum efficiency in the 800 nm wavelength together with a laser light illumination light source. The NIR image is converted to a hologram that is displayed on Microsoft HoloLens and is correctly co-registered with the operator’s natural eyesight.

Conference Presentation

Citation Download Citation

Nan Cui, Pradosh Kharel, and Viktor Gruev "Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery", Proc. SPIE 10049, Molecular-Guided Surgery: Molecules, Devices, and Applications III, 100490I (8 February 2017); https://doi.org/10.1117/12.2251625

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available