Deep learning-based single-shot fringe projection profilometry

Ruizhi Zuo; Shuwen Wei; Yaning Wang; Michael Kam; Justin D. Opfermann; Michael H. Hsieh; Axel Krieger; Jin U. Kang

doi:10.1117/12.3001837

12 March 2024 Deep learning-based single-shot fringe projection profilometry

Ruizhi Zuo, Shuwen Wei, Yaning Wang, Michael Kam, Justin D. Opfermann, Michael H. Hsieh, Axel Krieger, Jin U. Kang

Proceedings Volume 12831, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XXII; 1283106 (2024) https://doi.org/10.1117/12.3001837
Event: SPIE BiOS, 2024, San Francisco, California, United States

Abstract

Real-time fringe projection profilometry (FPP) is developed as a 3D vision system to plan and guide autonomous robotic intestinal suturing. Conventional FPP requires sinusoidal patterns with multiple frequencies, and phase shifts to generate tissue point clouds, resulting in a slow frame rate. Therefore, although FPP can reconstruct dense and accurate tissue point clouds, it is often too slow for dynamic measurements. To address this problem, we propose a deep learning-based single-shot FPP algorithm, which reconstructs tissue point clouds with a single sinusoidal pattern using a Swin-Unet. With this approach, we have achieved a FPP imaging frame rate of 50Hz while maintaining high point cloud measurement accuracy. System performance was trained and evaluated both by synthesized and an experimental dataset. An overall relative error of 1~3% was achieved.

Conference Presentation

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Ruizhi Zuo, Shuwen Wei, Yaning Wang, Michael Kam, Justin D. Opfermann, Michael H. Hsieh, Axel Krieger, and Jin U. Kang "Deep learning-based single-shot fringe projection profilometry", Proc. SPIE 12831, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XXII, 1283106 (12 March 2024); https://doi.org/10.1117/12.3001837

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available