Real-time multimodal 3D imaging system for remote estimation of vital signs

Chen Zhang; Ingo Gebhart; Peter Kühmstedt; Maik Rosenberger; Gunther Notni

doi:10.1117/12.2592660

20 June 2021 Real-time multimodal 3D imaging system for remote estimation of vital signs

Chen Zhang, Ingo Gebhart, Peter Kühmstedt, Maik Rosenberger, Gunther Notni

Proceedings Volume 11785, Multimodal Sensing and Artificial Intelligence: Technologies and Applications II; 117850F (2021) https://doi.org/10.1117/12.2592660
Event: SPIE Optical Metrology, 2021, Online Only

Abstract

The contactless estimation of vital signs based on conventional color cameras and ambient light can be affected by motions of patients and changes in ambient light. In this work, a multimodal 3D imaging system with an irritation-free controlled illumination was developed in order to mitigate these both problems. In the developed system the real-time high-precision 3D imaging is combined with VIS-NIR multispectral imaging and thermal imaging. Based on 3D data and color images, an approach was proposed for the efficient compensation of head motions, and novel approaches based on 3D regions of interest were developed for the estimation of heart rate, oxygen saturation, respiration rate, and body temperature from NIR multispectral video data and thermal video data. A proof-of-concept for the developed imaging system and algorithms can be delivered with first experimental results.

Conference Presentation

Citation Download Citation

Chen Zhang, Ingo Gebhart, Peter Kühmstedt, Maik Rosenberger, and Gunther Notni "Real-time multimodal 3D imaging system for remote estimation of vital signs", Proc. SPIE 11785, Multimodal Sensing and Artificial Intelligence: Technologies and Applications II, 117850F (20 June 2021); https://doi.org/10.1117/12.2592660

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available